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S YSTEM / METHOD AND APPARATUS FOR DATA TRANSMISSION 
PTBT.n OF THE TWVENTTOM 

The present invention relates to a system, method and 
apparatus for data transmission and/ more particularly, to 
a transmission processing of transmitting isochronous data 
which require transmission having transmission delay 
suppressed and asynchronous data which are not synchronized 
with other data, via a transmission line such as a data bus. 
BjvricflROiTNn of T HF twvbmtton 

Conventionally, there is a system of transmitting 
isochronous data having high real-time characteristics, 
like audio data or video data. This data transmission 
system can be utilized in a security system having plural 
monitoring cameras and one display device and composing 
video data from the respective cameras to display video on 
one display device, or rear-looking system mounted on a 
motor vehicle, having cameras which take images on right, 
left, and rear sides of the motor vehicle, in place of right 
and left side mirrors of the motor vehicle and composing 
video data from the cameras to display video on a monitor 

in the vehicle. 

Figure 30 is a diagram illustrating an example of the 
prior art data transmission system. 

The data transmission system 3000 as shown in figure 
30 comprises a first source device (transmission device) 
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3002 for receiving a video data 3012 from a first data output 
unit 3101 which is external to the system as a first 
isochronous data Dtl and transmitting the isochronous data 
Dtl at a predetermined timing, and a second source device 
(transmission device) 3003 for receiving a video data 3103 
from a second data output unit 3102 which is external to 
the system as a second isochronous data Dt2 and transmitting 
the isochronous data Dt2 at a predetermined timing. The 
data output units 3101 and 3102 are image-taking devices 
such as CCD (charge coupled device) cameras. The first 
source device 3002 has a transmission buffer 3022 which 
retains the isochronous data Dtl for a prescribed period, 
i.e. , from its input timing to its output timing. The second 
source device 3003 has a transmission buffer 3023 which 
retains the isochronous data Dt2 for a prescribed period, 
i.e., from its input timing to its output timing. 

The data transmission system 3000 comprises a sink 
device 3001 which is connected to the respective source 
devices 3002 and 3003 via a transmission line 3000a such 
as a data bus, for receiving the isochronous data 
transmitted by the respective source devices 3002 and 3003 
and outputting the isochronous data at a predetermined 
timing, and a video data buffer 3030 for containing an 
isochronous data 3011 output by the sink device 3001 and 
outputting the contained isochronous data to a video 
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composition device 3200 which is external to the system at 
an output timing corresponding to the video composition , 
device 3200. The sink device 3001 has a receiving buffer 
3021 which retains the received isochronous data Dtl and 
Dt2 for a prescribed period, i.e., from its receiving time 
to its output timing. 

in addition, the data transmission system 3000 can 
transmit/receive asynchronous data, other than the 
isochronous data, such as command data for controlling the 
respective devices, between the sink device 3001 and the 
respective source devices 3002 and 3003 via the transmission 
line 3000a. 

As shown in figure 30, the data transmission system 
3000 consisting of the source devices 3002 and 3003 which 
are mutually connected by the transmission line 3000a such 
as a data bus, and the sink device 3001 is called multimedia 
LAN (Local Area Network) or multimedia bus. 

Next, the operation of the data transmission system 
3000 will be described. 

Hereinafter, as a specific operation of the data 
transmission system 3000, a description is given of a case 
where the first and second video data 3012 and 3013 output 
from the data output units (cameras) 3101 and 3102 external 
to the system are transmitted by the data transmission 
system 3000 to the video composition device 3200 external 
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to the system, and then composition and display of the video 
data 3012 and 3013 is performed by the video composition 
device 3200. 

To be specific, the video data 3012 and 3013 which have 
been output from the data output units 3101 and 3102 external 
to the system are input to the corresponding source devices 
3002 and 3003 in the system 3000, respectively. 

in the source device 3002, the input video data 3012 
is retained in the transmission buffer 3022, and thereafter 
the video data 3012 is output to the transmission line 3000a 
as the isochronous data Dtl at a predetermined timing. In 
the source device 3003 , the input video data 3013 is retained 
in the transmission buffer 3023, and thereafter the video 
data 3013 is output to the transmission line 3000a as the 
isochronous data Dt2 at a predetermined timing. 

Then, in the sink device 3001, the isochronous data 
Dtl and Dt2 which have been transmitted from the source 
devices 3002 and 3003 to the transmission line 3000a at the 
predetermined timing are received, and the received 
isochronous data Dtl and Dt2 are retained in the receiving 
buffer 3021. 

Thereafter, in the sink device 3001, a processing of 
outputting the isochronous data Dtl and Dt2 retained in the 
receiving buffer 3021 to the video data buffer 3030 at the 
prescribed timing as a sink output 3011 is performed. At 



this time, the isochronous data Dtl and Dt2 are output in 
the order in which the data are received by the sink device. 

in the video data buffer 3030, a processing for 
delaying one of the isochronous data Dtl and Dt2 which have 
been input as the sink outputs is performed so that the output 
timings of the both data for respective frames coincide with 
each other. The isochronous data Dtl and Dt2 to be composed 
as data which form the same frame are output from the buffer 
3030 to the external video composition device 3200 at the 
same timing. 

in this video composition device 3200, a composed 
image of video taken by the respective cameras is displayed 
on the basis of composed video data which is obtained by 
the composition processing for the isochronous data Dtl and 
Dt2. 

in the above-mentioned prior art transmission system 
3000, the first and second source devices 3002 and 3003 
transmit the video data (isochronous data) to the sink 
device 3001 at their own timings, respectively. Therefore, 
in the sink device 3001, the isochronous data Dtl and Dt2 
from the respective source devices are received at arbitrary 
timings and stored in the transmission buffer 3021. 
Accordingly, the output timing corresponding to each trame 
of the isochronous data Dtl which is output from the 
transmission buffer 3021 as the buffer output 3011 does not 
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match the output timing corresponding to each frame of the 
isochronous data Dt2 which is output from the transmission 
buffer 3021 as the buffer output 3011. 

Thus, in the prior art transmission system 3000, the 
video data buffer 3030 for containing the buffer output 3011 
is provided in the subsequent stage of the transmission 
buffer 3021. Then, in the buffer 3030, the gap between the 
output timing corresponding to each frame of the isochronous 
data Dtl and the output timing corresponding to each frame 
&\ of the isochronous data Dt2 is absorbed. 

However, in the video data buffer 3030, the 
isochronous data is delayed to absorb the gap between the 
respective output timings of the isochronous data from the 
sink device 3001 . consequently, data delay occurs from the 
time when the sink device 3001 receives plural video data 
as isochronous data to the time when the video data are 
synchronized in a frame unit and output from the video data 
buffer 3030. 

Hereinafter, problems due to the data delay are 
described in more detail taking a motor vehicle in which 
plural cameras for assisting the sense of sight as 
substitutes for back mirrors and the data transmission 
system 3000 are mounted, and video data from the plural 
cameras as the substitutes for the back mirrors are 
transmitted by the system so as to display composed images 



of these data on a vehicle-mounted monitor, as an example- 
In this case, video images of backward views of the 
motor vehicle, displayed on the vehicle-mounted monitor are 
past images which have been delayed by a timing 
corresponding to the data delay in the sink device 3001, 
as compared to real time images taken by the camera. In the 
case of motor vehicles, it is not permissible to display 
the past images which have been delayed even a little from 
the real time, on the monitor as the substitutes for the 
back mirrors. Therefore, the prior art data transmission 
system 3000 has a poor practicality as the one which is to 
be utilized in a system in which data delay is not permissible, 
such as the above-mentioned vehicle-mounted rear looking 
system. 

Further, in the prior art data transmission system 
3000, the video data buffer 3030 is required to synchronize 
the video data output from the sink device 3001, 
corresponding to the respective data output units, in frame 
units . 

RUMMAGY " F TH B TWVP.NTION 

It is an object of the present invention is to provide 
a system, method and apparatus for data transmission which 
can synchronize individual isochronous data which are 
supplied from plural independent information sources to a 
transmission terminal in frame units to transmit the data 



to a receiving terminal, thereby synchronizing the 
isochronous data in frame units without using the data 
buffer and outputting the data from the receiving terminal 
Lo a required processing device. 

Other objects and advantages of the present invention 
will become apparent from the detailed description and 
specific embodiments described are provided only for 
illustration since various additions and modifications 
within the spirit and scope of the invention will be apparent 
to those of skill in the art from the detailed description. 

According to a 1st aspect of the present invention, 
there is provided a data transmission system comprising a 
transmission line for transmitting isochronous data to be 
processed at a timing in synchronization with a reference 
signal having a fixed cycle and asynchronous data to be 
processed at an arbitrary timing, plural source devices for 
transmitting the isochronous data to the transmission line, 
and at least one sink device for receiving plural pieces 
of the isochronous data which have been transmitted to the 
transmission line, and in the data transmission system, a 
specific device which is one of the sink device and the plural 
source devices transmits reference signal information for 
reproducing a predetermined reference signal as a reference 
for a processing timing of the isochronous data to the 
transmission line, and the plural source devices other than 
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the specific device receive the reference signal 
information which has been transmitted to the transmission 
line, obtain the predetermined reference signal, and output 
the isochronous data which are synchronized with the 
reference signal. Therefore, plural pieces of isochronous 
data between which data synchronization is established are 
obtained on the side of the sink device for receiving the 
plural pieces of isochronous data. Accordingly, the buffer 
for absorbing the phase difference between the isochronous 
data supplied from the plural source devices can be 
I* dispensed with. 

M According to a 2nd aspect of the present invention, 

jj in the data transmission system of the 1st aspect, the data 

transmission on the transmission line is repeatedly 
performed for each transmission frame as a unit of 
transmission data, the transmission frame has a frame header 
which contains information indicating the head of each 
transmission frame and an isochronous data slot which 
contains the isochronous data, and the specific device 
transmits the reference signal information with making the 
information to be included in the frame header. Therefore, 
in the existing data transmission method which uses the 
transmission frame having the frame header and the 
isochronous data slot, the reference signal information 
from the specific device can be transmitted without changing 
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the structure of data in the transmission frame. 

According to a 3rd aspect of the present invention, 
in the data transmission system of the 2nd aspect, the 
specific device periodically transmits the special frame 
header which includes the reference signal information. 
Therefore, the source devices other than the specific device 
can obtain the reference signal information in a fixed cycle 
in. Accordingly, the isochronous data which are always 
synchronized with the correct reference signal can be 
generated. 

According to a 4th aspect of the present invention, 
in the data transmission system of the 1st aspect, the data 
transmission on the transmission line is performed for each 
transmission frame as a unit of transmission data, the 
transmission frame has a frame header which contains 
information indicating the head of each transmission frame, 
an isochronous data slot which contains the isochronous data, 
and an asynchronous data slot which contains the 
asynchronous data, the sin* device performs a processing 
of transmitting/receiving the asynchronous data, in 
addition to the processing of receiving the isochronous data, 
the source device performs a processing of 
transmitting/receiving the asynchronous data, in addition 
to the processing of transmitting the isochronous data, and 
the specific device stores the reference signal information 



in the isochronous data slot or asynchronous data slot and 
transmits the isochronous data slot or asynchronous data 
slot. Therefore, the reference signal information can be 
multiplexed to the isochronous data or asynchronous data 
to be transmitted. 

According to a 5th aspect of the present invention, 
in the data transmission system of the 1st aspect, the 
specific device transmits a transmission/receipt 
designation packet which contains information designating 
a source device as a transmission source of the isochronous 
data and a sink device as a transmission destination of the 
isochronous data, to the transmission line, and a specific 
transmission/receipt designation packet which is 
transmitted from the specific device includes the reference 
signal information. Therefore, in the existing packet 
transmission method which uses the transmission/receipt 
designation packet, the reference signal information from 
the specific device can be transmitted without changing the 
structure of data to be transmitted in packets. 

According to a 6th aspect of the present invention, 
in the data transmission system of the 5th aspect, the 
specific device periodically transmits the specific 
transmission/receipt designation packet including the 
reference siqnal information. Therefore, the source 
devices other than the specific device can obtain the 
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reference signal information in the fixed cycle and generate 
the isochronous data which are always synchronized with the 
correct reference signal. 

According to a 7th aspect of the present invention, 
in the data transmission system of the 1st aspect, the sink 
device and the source device perform a processing of 
transmitting/receiving a data packet which contains the 
isochronous data or asynchronous data, and the specific 
device transmits the transmission/receipt designation 
packet which contains information designating the sink 
device as a transmission source of the isochronous data, 
the sink device as a transmission destination of the 
isochronous data, and the sink device or source device as 
a transmission source and transmission destination of the 
asynchronous data, to the transmission line, and transmits 
the reference signal information with making the 
information included in the isochronous data or 
asynchronous data. Therefore, Lhe reference signal 
information can be multiplexed to the isochronous data or 
asynchronous data to be transmitted. 

According to a 8th aspect of the present invention, 
in the data transmission system of the 1st aspect, the sink 
device and the source device perform a processing of 
transmitting/receiving a data packet which contains the 
isochronous data or asynchronous data, the data 
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transmission on the transmission line repeatedly performs 
a unit transmission processing for transmitting data in a 
fixed time period, the source and sink devices for 
transmitting the data packet in each transmission cycle as 
the period of the unit transmission processing perform 
arbitration for obtaining a transmission right to transmit 
the data packet, and transmit the data packet between a 
transmission source device which obtains the transmission 
right of the data packet by the arbitration and a 
transmission destination device corresponding to the 
transmission source device, and the specific device 
transmits a cycle start packet which indicates a start 
timing of the transmission cycle as the period of the unit 
transmission processing every fixed time period, and 
transmits the reference signal information to the 
transmission line with making the information included in 
the isochronous data or asynchronous data. Therefore, also 
in the existing packet transmission method in which 
arbitration is performed to obtain the transmission right 
to transmit data packets, the reference signal information 
can be transmitted from the special device without changing 
the structure of the data to be transmitted in packets. 

According to a 9th aspect of the present invention, 
in the data transmission system of the 1st aspect, plural 
individual transmission systems are formed, each including 
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at least one said source device and at least one said sink 
device, one specific device among the plural devices 
constituting each of the individual transmission systems 
transmits the reference signal information to other device 
in the individual transmission system including the 
specific device, and the device other than the specific 
device in each of the individual transmission systems 
receives the reference signal information transmitted from 
the specific device, and reproduces a reference signal 
inherent to each of the individual transmission systems. 
I' Therefore, also when the sink devices and the source devices 

si T 

^ constituting the system are divided in plural groups as 

; i 2 

ijj individual transmission systems, the device which utilizes 

U the isochronous data transmitted from the source device of 

the individual transmission system can obtain isochronous 
data between which the synchronization is established as 
the plural pieces of isochronous data. 

According lo a 10th aspect of Lhe present invention, 
in the data transmission system of the 1st aspect, the sink 
device comprises a phase detector for detecting a phase 
shift amount of the received plural pieces of isochronous 
data, and transmits phase difference information which 
indicates the phase shift amount detected by the phase 
detector, and at least one of the plural source devices 
modifies a timing of reproducing the reference signal from 
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the reference signal information on the basis of the phase 
difference information which is transmitted from the sink 
device so as to reduce the phase shift amount in the sink 
device. Therefore, even when the phase difference between 
the isochronous data from two source devices occurs due to 
the data delay on the transmission line, the isochronous 
data having the synchronization established can be 
obtained . 

According to an 11th aspect of the present invention, 
there is provided a data transmission system comprising a 
source device for transmitting isochronous data to be 
processed at a timing in synchronization with a reference 
signal having a fixed cycle, a sink device for receiving 
the isochronous data which have been transmitted from the 
source device, and first and second transmission lines 
having different data transmission directions, which 
connect the source device and the sink device in one-to-one 
relationship, and in the data transmission system, the sink 
device performs an information transmission processing of 
transmitting reference signal information for reproducing 
a predetermined reference signal as a reference of a 
processing timing of the isochronous data, to the source 
device via the first transmission line, the source device 
performs a signal reproduction processing of receiving the 
reference signal information from the sink device and 
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reproducing the predetermined reference signal from the 
received reference signal information, and a data 
transmission processing of transmitting the isochronous 
data to the sink device via the second transmission line 
in synchronization with the reproduced predetermined 
reference signal, and a transmission speed of the 
isochronous data on the second transmission line is higher 
than a transmission speed of the reference signal 
information on the first transmission line. Therefore, 
when the isochronous data are transmitted using a plurality 
of the systems, the device for receiving the isochronous 
data can obtain isochronous data having the frame 
synchronization established as plural pieces of the 
isochronous data. Accordingly, the buffer for absorbing 
the phase difference between the isochronous data supplied 
from the plural source devices can be dispensed with. 
Further, cheaper elements can be used for the transmission 
lines for transmitting data from the sink device to the 
source device. Besides, a cheaper transmission/receiving 
unit for performing the data transmission from the sink 
device to the source device can be used. Therefore, the 
low-cost and efficient data transmission can be performed. 

According to a 12th aspect of the present invention,, 
in the data transmission system of the llth aspect, the sink 
device and the source device perform a processing of 
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transmitting/receiving asynchronous data to be processed 
at arbitrary timing, the data transmission on each of the 
transmission lines is performed for each transmission frame 
as a unit of transmission data, data transmission from the 
sink device to the source device is performed in a unit of 
a first transmission frame which has a frame header 

indicating the head of each transmission frame and an 
asynchronous data slot containing the asynchronous data to 
be processed at arbitrary timing, data transmission from 
the source device to the sink device is performed in a unit 
of a second transmission frame which has the frame header, 
an isochronous data slot containing the isochronous data 
and the asynchronous data slot, and the sink device 
transmits the reference signal information with making the 
information included in the frame header of the first 
transmission frame. Therefore, in the existing data 
transmission method which uses a transmission frame having 
the frame header and the isochronous data slot, the 
transmission of the reference signal information can be 
performed without changing the structure of data in the 
transmission frame. 

According to a 13th aspect of the present invention, 
in the data transmission system of the 12th aspect, the sink 
device transmits the frame header including the processing 
timing information in a fixed cycle. Therefore, the source 
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device can obtain the reference signal information in the 
fixed cycle and generate the isochronous data which are 
always synchronized with the correct reference signal. 

According to a 14th aspect of the present invention, 
in the data transmission system of the 11th aspect, the sink 
device and the source device perform a processing of 
transmitting/receiving asynchronous data to be processed 
at arbitrary timing, the data transmission on each of the 
transmission lines is performed for each transmission frame 
as a unit of transmission data, data transmission from the 
sink device to the source device is performed in a unit of 
a first transmission frame which has a frame header 
indicating the head of each transmission frame and an 
asynchronous data slot containing the asynchronous data to 
be processed at arbitrary timing, data transmission from 
the source device to the sink device is performed in a unit 
of a second transmission frame which has the frame header 
and an isochronous data slot containing the isochronous data 
and the asynchronous data slot, and the sink device 
transmits the reference signal information with making the 
reference signal information included in the asynchronous 
data. Therefore, the reference signal information can be 
multiplexed to the isochronous data or asynchronous data 
to be transmitted. 

According to a 15th aspect of the present invention, 
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in the data transmission system of the 11th aspect, the sink 
device stores information which designates a device as a 
transmission source of the isochronous data and a device 
as a transmission destination of the isochronous data, in 
a transmission/receipt designation packet, and transmits 
the transmission/receipt designation packet to the first 
transmission line, and a specific transmission/receipt 
designation packet which is transmitted from the sink device 
includes the reference signal information. Therefore, in 
the existing packet transmission method which uses the 
transmission/receipt designation packet, the reference 
signal information can be transmitted from the specific 
device without changing the structure of data to be 
transmitted in packets. 

According to a 16th aspect of the present invention, 
in the data transmission system of the 15th aspect, the sink 
device periodically transmits the specific 
transmission/receipt designation packet including the 
reference signal information. Therefore, in the source 
device, the reference signal information can be obtained 
in the fixed cycle and the isochronous data which are always 
synchronized with the correct reference signal can be 
generated . 

According to a 17th aspect of the present invention, 
in the data transmission system of the 11th aspect, the sink 
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device performs a processing of transmitting/receiving 
asynchronous data to be processed at an arbitrary timing 
as well as performs a processing of storing information 
which designates a device as a transmission source of the 
isochronous data or asynchronous data and a device as a 
transmission destination of the isochronous data or 
asynchronous data, in a transmission/receipt designation 
packet to be, transmitted to the first transmission line, 
and storing the reference signal information in a required 
asynchronous data packet among asynchronous data packets 
including the asynchronous data to be transmitted to the 
first transmission line, and the source device performs a 
processing of transmitting /receiving the asynchronous data 
to be processed at an arbitrary timing as well as transmits 
an isochronous data packet which contains the isochronous 
data to the second transmission line. Therefore, the 
reference signal information can be multiplexed to the 
asynchronous data to be transmitted. 

According to an 18th aspect of the present invention, 
in the data transmission system of the 1st or 11th aspect, 
the transmission line is composed of an optical fiber- 
Therefore, the data transmission can be performed at high 
speeds . 

According to a 19th aspect of the present invention, 
in the data transmission system of the 1st aspect, the sink 
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device and the source device transmit /receive data as an 
optical signal, and the transmission line comprises: an 
optical star coupler having plural input terminals and 
plural output terminals, and outputting the optical signal 
which has been supplied to any of the input terminals from 
all of the output terminals; output side optical fibers for 
connecting output terminals of the sink device and the 
source device and the input terminals of the optical star 
coupler; and input side optical fibers for connecting input 
terminals of the sink device and the source device and the 
output terminals of the optical star coupler. Therefore, 
even when the data communication is interrupted on one of 
the transmission lines, the data transmission can be 
performed via other transmission lines, thereby improving 
the reliability of the data transmission. 

According to a 20th aspect of the present invention, 
in the data transmission system of the 11th aspect, the sink 
device transmits output data as an electric signal and 
receives input data as an optical signal, the source device 
transmits output data as an optical signal and receives 
input data as an electric signal, the first transmission 
line for transmitting data from the sink device to the source 
device is composed of a conductor which propagate the 
electric signal, and the second transmission line for 
transmitting data from the source device to the sink device 
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is composed of an optical fiber which propagate the optical 
signal. Therefore, the transmission of data having a 
smaller data amount is performed by the first transmission 
line, and the transmission of data having a larger data 
amount is performed by the second transmission line. 
Accordingly, the data transmission system which has good 
transmission efficiency and is cheaper can be realized. 

According to a 21st aspect of the present invention, 
in the data transmission system of the 1st or 11th aspect, 
the source device is connected to a video data output unit 
which has an image-taking unit for performing an image- 
taking processing or a video reproduction unit for 
performing a reproduction processing for video data, and 
transmits the video data output from the video data output 
unit to the transmission line as isochronous data, and the 
sink device is connected to a video processing device for 
composing or recording plural pieces of video data, and 
receives the plural pieces of video data which have been 
transmitted from the plural source devices as isochronous 
data to supply the data to the video processing device. 
Therefore, the navigation system with real images in the 
motor vehicle or the like, a drive recorder in the motor 
vehicle or the like, or a monitoring camera system can be 
realized. 

According to a 22nd aspect of the present invention, 
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in the data transmission system of th 21st aspect, the source 
device comprises a video compression unit for compressing 
the video data which have been supplied from the video data 
output unit and ouLputting compressed video data, and 
transmits the compressed video data as the isochronous data. 
Therefore, the data amount of the isochronous data which 
are transmitted from the source device can be reduced. 

According to a 23rd aspect of the present invention, 
in the data transmission system of the 1st or 11th aspect, 
the sink device, the source device, and the transmission 
line which connects these devices are mounted on a motor 
vehicle, the source device is connected to a motor- 
vehicle-mounted video data output unit having an image- 
taking unit for performing an image-taking processing or 
a video reproduction unit for performing a reproduction 
processing for video data, and transmits the video data 
which have been output from the video data output unit as 
the isochronous data to the transmission line, the sink 
device is connected to a motor-vehicle-mounted video 
processing device for composing or recording plural pieces 
of video data, and receives the plural pieces of video data 
which have been transmitted from the plural source devices 
as the isochronous data to supply the data to the video 
processing device, and the sink device, the source device, 
and the transmission line constitute a network for 
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transmitting the video data in the motor vehicle. Therefore, 
the motor-vehicle-mounted navigation system with real 
images or the motor-vehicle-mounted drive recorder can be 
realized . 

According to a 24th aspect of the present invention, 
there is provided a data transmission method for 
transmitting isochronous data to be processed at a timing 
in synchronization with a reference signal having a fixed 
cycle and asynchronous data to be processed as an arbitrary 
timing, from plural source devices as transmission sources 
of the isochronous data, to at least one sink device as a 
transmission destination of the isochronous data via a 
transmission line comprising: a data transmission step of 
transmitting reference signal information for reproducing 
a predetermined reference signal as a reference of a 
processing timing of the isochronous data from a specific 
device among the sink device and the plural source devices 
to the transmission line; and a signal reproduction step 
of receiving the reference signal information which has been 
transmitted to the transmission line and reproducing the 
reference signal in the plural source devices. Therefore, 
plural pieces of isochronous data between which data 
synchronization is established can be obtained on the side 
of the sink device for receiving the plural pieces of 

;hronous data, and the buffer for absorbing the phase 
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difference between the isochronous data supplied from the 
plural source devices can be dispensed with- 

According to a data transmission method of a 25th 
aspect of the present invention, there is provided a data 
transmission system for transmitting isochronous data to 
be processed at a timing in synchronization with a reference 
signal having a fixed cycle from a source device as a 
transmission source of the isochronous data to a sink device 
as a transmission destination of the isochronous data which 
is connected to the source device in one-to-one relationship 
{: comprising: an information transmission step of 

transmitting reference signal information for reproducing 
a predetermined reference signal as a reference of a 
processing timing of the isochronous data, from the sink 
device to the source device via a first transmission line; 
a signal reproduction step of receiving the reference signal 
information from the sink device and reproducing the 
predetermined reference signal in the source device; and 
a data transmission step of transmitting the isochronous 
data to the sink device via a second transmission line in 
synchronization with the reproduced predetermined 
reference signal, and in the data transmission method, a 
transmission speed of the isochronous data on the second 
transmission line is higher than a transmission speed of 
the reference signal information on the first transmission 
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line. Therefore, when the transmission of the isochronous 
data is performed using the isochronous data and a plurality 
of the systems having the source device, the device for 
receiving the isochronous data can obtain the isochronous 
data between which the frame synchronization is established 
as the plural pieces of isochronous data. Accordingly, the 
buffer for absorbing the phase difference between the 
isochronous data which are supplied from the plural source 
devices can be dispensed with. Further, the transmission 
speed of the isochronous data on the second transmission 
line is higher than the transmission speed of the reference 
signal information on the first transmission line. 
Therefore, cheaper elements can be used for the transmission 
line for transmitting data from the sink device to the source 
device, and a cheaper transmission/receiving unit for 
performing data transmission from the sink: device to the 
source device can be used. Accordingly, the low-cost and 
efficient data transmission can be performed. 

According to a 26th aspect of the present invention, 
there is provided a data transmission apparatus which is 
connected to a transmission line, and transmits or receives 
isochronous data to be processed at a timing in 
synchronization with a reference signal having a fixed cycle 
and asynchronous data to be processed at an arbitrary timing 
via the transmission line comprising: a controller for 
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controlling the transmission or receipt of the isochronous 
data and asynchronous data; and a reference signal generator 
for reproducing the reference signal on the basis of 
reference signal information for reproducing a 
predetermined reference signal as a reference of a 
processing timing of the isochronous data, which have been 
received as the asynchronous data. Therefore, in the device 
for receiving the plural pieces of isochronous data, the 
plural pieces of the isochronous data between which the 
synchronization is established can be obtained. 
Accordingly, the buffer for absorbing the phase difference 
between the isochronous data which are supplied from the 
plural data transmission sources can be dispensed with. 

According to a 27th aspect of the present invention, 
the data transmission apparatus of the 26th aspect comprises 
an image-taking unit for performing an image-taking 
processing and outputting video data, and in the data 
transmission apparatus, the image-taking unit outputs the 
video data in synchronization with the reference signal 
which has been reproduced by the reference signal generator, 
and the controller transmits the video data which have been 
output from the image-taking unit as the isochronous data 
to the transmission line. m the device for receiving the 
plural pieces of video data, the plural pieces of video data 
between which the synchronization is established can be 
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obtained. 

According to a 28th aspect of the present invention, 
the data transmission apparatus of Claim 27 comprises: a 
video compression unit for compressing the video data from 
the image-taking unit and outputting compressed video data, 
and in the data transmission apparatus, the controller 
transmits the compressed video data as the isochronous data. 
Therefore, the data amount of the isochronous data which 
are transmitted from the transmission source of the video 
data can be reduced. 
PR T RF ny qrwTPTTOTJ of the DRAWINGS 

Figure 1 is a diagram illustrating a data transmission 
system according to a first embodiment of the present 

invention. 1 

Figure 2(a) is a diagram illustrating a structure of 
a sink device in the data transmission system of the first 
embodiment, figure 2(b) is a diagram illustrating a 
structure of a first source device, and figure 2(c) is a 
diagram illustrating a structure of a second source device. 

Figure 3 is a diagram illustrating a data structure 
of a transmission data which propagates on a transmission 
line of the data transmission system (transmission frame 
format) according to the first embodiment. 

Figure 4(a) is a diagram illustrating a data structure 
of a transmission data which propagates on the transmission 
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line of the data transmission system according to the first 
embodiment, and figures 4(b) and 4(c) are diagram 
illustrating timing reference signals which are reproduced 
by the first and second source devices in the data 
transmission system. 

Figures 5(a) to 5(f) are diagrams for explaining a 
processing for transmission data in the data transmission 
system of the first embodiment. Figures 5(a) and 5(c) show 
the timing reference signals from the first and second 
source devices. Figures 5(b) and 5(d) show video data to 
the first and second source devices. Figure 5(e) shows a 
transmission data Td on a transmission line. Figure 5(f) 
and 5(g) show a video data from the sink device. 

Figures 6(a) to 6(c) are diagram for explaining a case 
where synchronous information is transmitted using an 
isochronous data slot in the data transmission system of 
the first embodiment, and show data arrangement in a 
transmission frame of data which propagate on transmission 

lines 100a, 100b and 100c. 

Figure 7 is a diagram illustrating a data transmission 
system of a second embodiment of the present invention. 

Figure 8(a) is a diagram illustrating a structure of 
a sink device of the data transmission system according to 
the second embodiment, figure 8(b) is a diagram illustrating 
a structure of a first source device, and figure 8(c) is 
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a diagram illustrating a second source device. 

Figure 9 is a diagram illustrating a data structure 
of a transmission data which propagate on a transmission 
line of the data transmission system (transmission frame 
format) according to the second embodiment. 

Figure 10(a) is a diagram illustrating a data 
structure of transmission data which propagate on a 
transmission line of the data transmission system according 
to the second embodiment. Figures 10 (b) and 10(c) are 
diagrams illustrating timing reference signals which are 
reproduced by the first and second source devices in the 
data transmission system. 

Figures 11(a) to 11(f) are diagram for explaining a 
processing for transmission data in the data transmission 
system of the second embodiment. Figures 11(a) and 11(c) 
show timing reference signals from the first and second 
source devices. Figures 11(b) and 11(d) are video data to 
the first and second source devices. Figure 11(e) shows a 
transmission data Td on a transmission line. Figure 11(f) 
and 11(g) show a video data from the sink device. 

Figure 12 is a diagram illustrating an example of the 
system in a case where the connection form of the devices 
in the data transmission system of the second embodiment 
is changed from connection in the form of a ring to bus 
connection - 
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Figure 13 is a diagram illustrating a system in which 
the connection form of the devices in the data transmission 
system of the second embodiment is replaced with a 
connection form in which data input side transmission lines 
and data output side transmission lines of the sink device 
and the first and second source devices are separated using 
a multi-input-multi-output signal distributor and the 
devices are connected via buses. 

Figure 14 is a diagram illustrating a system in which 
the connection form of the devices in the data transmission 
system of the second embodiment is replaced with a 
connection form in which data input side transmission lines 
and data output side transmission lines of first, second 
and third groups of data transmission apparatus are 
separated using a multi-input-multi-output signal 
distributor and the groups are connected via buses. 

Figure 15 is a diagram illustrating a data 
transmission system of a third embodiment of the present 
invention . 

Figure 16(a) is a diagram illustrating a sink device 
of the data transmission system according to the third 
embodiment, figure 16(b) is a diagram illustrating a first 
source device of the data transmission system, and figure 
16(c) is a diagram illustrating a second source device of 
the data transmission system- 
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Figure 17 is a diagram illustrating a data structure 
of transmission data which propagate on a transmission line 
of the data transmission system (transmission frame format) 
according to the third embodiment. 

Figure 18(a) is a diagram illustrating a data 
structure of transmission data which propagate on a 
transmission line of the data transmission system of the 
third embodiment, and figures 18(b) and 18(c) are diagram 
illustrating timing reference signals which are reproduced 
by the first and second source devices of the data 
transmission system. 

Figures 19(a) to 19(f) are diagrams for explaining a 
processing for transmission data in the data transmission 
system of the third embodiment. Figures 19(a) and 19(c) 
show timing reference signals from the first and second 
source devices. Figures 19(b) and 19(d) show video data to 
the first and second source devices. Figure 19(e) shows a 
transmission data Td on a transmission line. Figure 19(f) 
and 19(g) show a video data from the sink device. 

Figure 20 is a diagram illustrating a sink device in 
a data transmission system of a fourth embodiment of the 
present invention. 

Figures 21(a) to 21(f) are diagrams illustrating 
input/output signals from/to devices of the data 
transmission system of the fourth embodiment. Figures 
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21(a) and 21(b) show video data from the sink devices. 
Figures 21(d) and 21(f) show video data to the second source 
device. Figures 21(c) and 21(e) show frame synchronous 
signals corresponding to the video data. 

Figure 22 is a diagram illustrating a data 
transmission system of a fifth embodiment of the present 
invention . 

Figure 23 is a diagram illustrating a data 
transmission system of a sixth embodiment of the present 
invention . 

Figure 24(a) is a diagram illustrating a transmission 
frame of transmission data which propagate on a transmission 
line of the data transmission system according to the sixth 
embodiment. Figure 24(b) is a diagram illustrating a 
transmission frame on a low-speed transmission line. 
Figure 24(c) is a diagram illustrating a transmission frame 
on a high-speed transmission line. 

Figure 25 is a diagram illustrating a data 
transmission system according to a seventh embodiment of 
the present invention. 

Figure 26(a) is a diagram illustrating an example of 
transmission frame on a low-speed transmission line of 
the data transmission system according to the seventh 
embodiment, and figure 26(b) is a diagram illustrating an 
example of a transmission frame on a high-speed transmission 
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line of the system. 

Figure 27(a) is a diagram illustrating another example 
of the transmission frame on the low-speed transmission line 
of the data transmission system according to the seventh 
embodiment, and figure 27(b) is a diagram illustrating 
another example of the transmission frame on the high-speed 
transmission line of the system. 

Figures 28(a) to 28(e) are diagram for explaining a 
processing of transmitting a multiplexed signal as 
isochronous data in the data transmission system according 
to any of the aforementioned embodiments. Figures 28(a) and 
28(d) show timing reference signals, figure 28(b) and 28(e) 
show video data, and figure 28(c) shows a multiplexed 
signal. 

Figures 29(a) to 29(c) are diagram for explaining a 
data transmission system according to an eighth embodiment 
of the present invention- Figure 29(a) shows a data 
transmission apparatus as a sink device or source device. 
Figure 29(b) shows a camera device as a source device. 
Figure 29(c) shows a camera device having a compression 
unit . 

Figure 30 is a diagram illustrating a prior art data 
transmission system. 

nPTATT.PD nBSfRTPTTQW OF T HE PREFERRED EMBOPIME NT_S_ 

Hereinafter, embodiments ot the present invention 
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will be described. 
[Embodiment: 1] 

Figure 1 is diagram illustrating a data transmission 
system according to the first embodiment of the present 
invention. 

The data transmission system 10 of the first 
embodiment comprises a first source device 102 for receiving 
a data having high real-time characteristics like audio or 
video data from a first data output unit 1011 such as a camera 
external to the system and transmitting the data as an 
isochronous data Dtl, and a second source device 103 for 
receiving a data having high real-time characteristics like 
audio or video data from a second data output unit 1012 such 
as a camera external to the system and transmitting the data 
as an isochronous data Dt2 . 

The data transmission system 10 further comprises a 
sink device 101 for receiving the isochronous data Dtl and 
Dt2 which are transmitted from the source devices 102 and 
103 and outputting the isochronous data Dtl and Dt2 to a 
video composition device 1020 external to the system, a 
first transmission line 100a for transmitting data between 
the sink device 101 and the first source device 102, a second 
transmission line 100b for transmitting data between the 
first and second source devices 102 and 103, and a third 
transmission line 100c for transmitting data between the 
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second source device 103 and the sink device 101. 

In this data transmission system 10, the sink device 
101, the first and second source devices 102 and 103, and 
the first to third transmission lines 100a to 100c 
constitute one data transmission path in a form of ring. 
In addition, in this data transmission system 10, the 
respective devices 101 to 103 operate with the same system 
clock, to be specific, with an operational clock of one 
device of these devices 101 to 103 (for example, the sink 
device 101) , operational clocks of other devices (the source 
devices 102 and 103) are synchronized. 

Figure 2(a) is a diagram illustrating a detailed 
structure of the sink device. 

This sink device 101 comprises a controller 201a for 
performing a processing of receiving a transmission data 
Td from the transmission line 100c, a processing of 
transmitting the transmission data Td to the transmission 
line 100a, and a processing of controlling the video 
composition device 1020 external to the system, and a 
reference signal generator 202a for generating a reference 
signal 208a on the basis of reference signal information 
Is included in the received transmission data Td . 

The reference signal is a signal having a fixed cycle 
as a reference of processing timing of isochronous data 
(hereinafter, referred to also as timing reference signal) . 
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The reference signal information is information for 
reproducing the reference signal, which relates to the 
frequency or phase of the reference signal (hereinafter, 
referred to as synchronous information). In addition/ the 
isochronous data are not limited to video data or audio data, 
and can be any type of data as long as the data are processed 
at a timing in synchronization with the reference signal 
having a fixed cycle. Further, the asynchronous data are 
not limited to the control commands/ and can be any type 
of data as long as the data are processed at arbitrary 
timings . 

Here/ the reference signal 208a is a frame synchronous 
signal for determining a timing of composition of the 
isochronous data for each frame by the video composition 
device 1020. The receiving processing of the controller 
201a is a processing of receiving the transmission data Td 
from the transmission line 100c and outputting an 
isochronous dala 204al and 204a2 included in the data to 
the video composition device 1020 external to the system. 
In addition, the transmission processing of the controller 
201a is a processing of transmitting synchronous 
information (reference signal information) 207a from the 
video composition device 1020 to the transmission line 100a 
as a part of the transmission data Td . This synchronous 
information 20 7a is a synchronous signal indicating a timing 
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of composition of plural isochronous data for each frame 
by the video composition device 1020 , Further, the cpntrol 
processing of the controller 201a is a processing of 
transmitting/receiving an asynchronous data 203a such a 
command for controlling the video composition device 1020, 
to/from the video composition device 1020* 

In this data transmission system 10 of the first 
embodiment, the sink device 101 outputs the synchronous 
information of the data transmission system 10 . Therefore, 
a synchronous information output processing in the 
controller 201a of outputtlng the synchronous information 
Is included in the received transmission data Td to the 
reference signal generator 202a, and an operation in the 
reference signal generator 202a of generating the reference 
signal 208a on the basis of the synchronous information Is 
are not required. However, when the source device other 
than the sink device 101 of the data transmission system 
10 generates the synchronous information of the data 
transmission system 10, the synchronous information output 
processing in the controller 201a and the operation in the 
reference signal generator 202a of generating the reference 
signal 208a are performed. 

Figure 2(b) is a diagram illustrating a detailed 
structure of the first source device. 

The source device 102 comprises a controller 201bl for 
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performing a processing of receiving the transmission data 
Td from the transmission line 100a, a processing of 
transmitting the transmission data Td to the transmission 
line 100b/ and a processing of controlling the first data 
output unit (camera) 1011 external to the system, and a 
reference signal generator 202bl for generating a reference 
signal 208bl on the basis of the synchronous information 
Is included in the received transmission data Td . 

Here, the reference signal 208bl is a synchronous 
signal for determining a timing of outputting video data 
of each frame by the first data output unit 1011. The 
receiving processing of the controller 201bl is a processing 
of receiving the transmission data from the transmission 
line 100a and outputting the synchronous information Is 
included in the transmission data to the reference signal 
generator 202bl . In addition, the transmission processing 
of the controller 201bl is a transmission processing of 
transmitting a video data 205 from the first data output 
unit 1011 to the transmission line 100b as a part of the 
transmission data Td (isochronous data). The control 
processing of the controller 201bl is a processing of 
transmitting/receiving an asynchronous data 203bl such as 
a command for controlling the first data output unit 1011 
to/from the data output unit 1011. 

In the data transmission system 10 of the first 
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embodiment , the sink device 101 generates the synchronous 
information of the data transmission system 10. However, 
when the source device 102 outputs the synchronous 
information of the data transmission system 10, a 
transmission processing of transmitting a synchronous 
information 207bl from the first data output unit 1011, 
which indicates the operational timing as a part of the 
transmission data Td to the transmission line 100b is also 
performed in the controller 201bl, in addition to the 
processing of transmitting the isochronous data. To be 
specific/ the synchronous information 207bl indicating the 
operational timing is a frame synchronous signal which 
indicates a timing of outputting the video data of each frame 
by the first data output unit 1011 to the source device 102. 

Figure 2(c) is a diagram illustrating a detailed 
structure of the second source device. 

The source device 103 comprises a controller 201b2 for 
performing a processing of receiving the transmission data 
Td from the transmission line 100b, a processing of 
transmitting the transmission data Td to the transmission 
line 100c, and a processing of controlling the second data 
output unit (camera) 1012 external to the system, and a 
reference signal generator 202b2 for generating a reference 
signal 208b2 on the basis of the synchronous information 
is included in the received transmission data Td. 
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Here, the reference signal 208b2 is a synchronous 
signal for determining a timing of outputting video data 
of each frame by the second data output unit 1012. The 
receiving processing of the controller 201b2 is a processing 
of receiving the transmission data from the transmission 
line 100b and outputting the synchronous information Is 
included in the transmission data to the reference signal 
generator 202b2. In addition, the transmission processing 
of the controller 201b2 is a transmission processing of 
transmitting a video data 206 from the second data output 
unit 1012 to the transmission line 100c as a part of the 
transmission data Td (isochronous data). The control 
processing of the controller 201b2 is a processing of 
transmitting/receiving an asynchronous data 203b2 such as 
a command for controlling the second data output unit 1012 
to/from the data output unit 1012. 

As described above, in the data transmission system 
10 of the first embodiment, the sink device 101 generates 
the synchronous information of the data transmission system 
10. However, when the source device 103 outputs the 
synchronous information of the data transmission system 10, 



in the second data output unit 1012 as a part of the 
transmission data Td to the transmission line 100c is a 
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performed in the controller 201b2, in addition to the 
processing of transmitting the isochronous data. To be 
specific, the synchronous information 207b2 indicating the 
operational timing is a frame synchronous signal which 
indicates a timing of outputting the video data of each frame 
by the second data output unit 1012 to the source device 
103 . 

Figure 3 is a diagram illustrating data structure 
(transmission frame format) of the transmission data to be 
transmitted on the transmission lines 100a to 100c. 

The transmission data Td is composed of plural data 
blocks which are transmitted in a prescribed cycle, i.e., 
transmission frames (#1) Tdl, (#2) Td2, (#3) Td3, ...(#k) 
Tdk. 

For example, the transmission frame (#2) Td2 is 
composed of a frame header 301 indicating the head of the 
transmission frame (#2), an isochronous data slot 302 for 
transmission of isochronous data by the respective source 
devices, and an asynchronous data slot 303 for transmitting 
asynchronous data such as control data or status data. 

Here, the isochronous data slot 302 is divided into 
a first individual data slot 302al, a second individual data 
slot 302a2, a third individual data slot 302a3 , . . . , a m-th 
individual data slot 302am. Then, the individual data slots 
302al to 302am are previously allocated to the isochronous 
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data which are transmitted from the source devices, 
respectively. For example, in this first embodiment, the 
first individual data slot 302al is allocated to the 
isochronous data to be transmitted from the first source 
device 102 to the sink device 101, and the second individual 
data slot 302a2 is allocated to the isochronous data to be 
transmitted from source device 103 to the sink device 101. 

In this first embodiment, the asynchronous data slot 
is not divided into individual data slots like the 
isochronous data slots 302. However, it is also possible 
that the asynchronous data slot is divided into individual 
data slots like the isochronous data slots 302, and then 
the respective individual data slots are allocated to data 
which are output from the sink device 101 and the source 
devices 102 and 103, respectively. Further, the devices 101 
to 103 also can use the asynchronous data slot for the data 
transmission as needed. 

Figure 4(a) shows the transmission data which 
propagates on the transmission line in the data transmission 
system 10 of the first embodiment. Figures 4(b) and 4(c) 
show reference signals which are reproduced by the first 
and second source devices, respectively. 

in the n-th transmission frame (#n) and the (n+1)- 
th transmission frame (#n+l) of the transmission data Td, 
frame headers 401 and 402 indicating the head of each of 
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the frames are located. Following to these frame headers , 
the isochronous data slots 302 and the asynchronous data 
slots 303 are located. Here, the frame header 401 in the 
n-th transmission frame (#n) is a special frame header which 
includes synchronous information inherent to the 
isochronous data corresponding to this frame. The frame 
header 402 in the (n+l)-th transmission frame (#n+l) is a 
normal frame header which does not include the synchronous 
information. At the head of each transmission frame, the 
normal frame header 402 or the special frame header 401 is 
always located. 

The synchronous information inherent to the 
isochronous data which are included in the special frame 
header is reproduced by the reference signal generator 202bl 
of the source device 102 as the reference signal 208bl 
(figure 4(b)). The synchronous information is reproduced 
by the reference signal generator 202b2 of the source device 
103 as the reference signal 208b2 (figure 4(c)). 

Next, the operation of the data transmission system 
will be described. 

Figures 5(a)-5(f) are diagrams for explaining the 
operation of the data transmission system 10. Figure 5(a) 
shows the reference signal 208bl which is output from the 
reference signal generator 202b of the source device 102. 
Figure 5(b) shows the video data 205 which is input from 
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the first data output unit 1011 to the controller 201bl of 
the source device 102. Figure 5(c) shows the reference 
signal 208b2 which is output from the reference signal 
generator 202b2 of the source device 103 . Figure 5(d) shows 
the video data 206 which is input from the second data output 
unit 1012 to the controller 201b2 of the source device 103, 
Figure 5(e) shows the transmission data Td on the 
transmission line 100. Figure 5(f) and 5(g) show the video 
data 204al and 204a2 which are output from the controller 
201a of the sink device 101 to the video composition device 
1020 (i.e., video data 205 and 206 which are output from 
the first and second data output units) . Here, synchronous 
signals as shown in figures 5(a) and 5(c) are the same as 
those shown in figures 4(b) and 4(c) , respectively. 

Initially, the synchronous information 207a is input 
to the sink device 101 from the video composition device 
1020 external to the system. This synchronous information 
represents a timing signal as the reference of a processing 
of composing two kinds of video data, i.e., the video data 
from the first and second data output units 1011 and 1012, 
in the video composition device 1020. For example, as the 
synchronous information, a frame synchronous signal which 
indicates the head of the video frame is employed. 

Here, the synchronous information (reference signal 
information) is not limited to the frame synchronous signal 
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but can be information which can reproduce the frame 
synchronous signal. For example, the synchronous 
information can include frequency information indicating 
the frequency of the frame synchronous signal and phase 
information indicating the phase of the frame synchronous 
signal. Here, the frequency information is information 
which indicates that the frame synchronous* signal is 
obtained by x-dividing (X is a positive integer) an 
operational clock of the system or information which 
indicates the cycle of the reference signal or the like. 
The phase information is information which indicates the 
timing of a rising edge or a falling edge of the frame 
synchronous signal or time information which indicates the 
phase with respect to the rising edge or falling edge or 
the like. Further, as the operational clock of the system, 
an operational clock of one of the sink device 101 and the 
source devices 102 and 103 in the data transmission system 
10, and the video composition device 1020 and the first and 
second data output units (cameras) which are external to 
the system is employed. 

When the synchronous information 207a from the video 
composition device 1020 external to the system is input to 
the sink device 101, the controller 201a performs the 
transmission processing of multiplexing the synchronous 
information and the special frame header 401 of a 
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predetermined transmission frame and transmitting the 
multiplexed information to the transmission line 100a. The 
simplest method of multiplexing the synchronous information 
and the special frame header 401 is a method of generating 
the special frame header 401 in synchronization with the 
frame synchronous signal. To be more specific, the special 
frame header 401 is generated every predetermined number 
of transmission frames at the rising or falling timing of 
the frame synchronous signal. Thereby, it can be found that 
the timing of receiving the special frame header of the 
transmission frame on the receiving end of the transmission 
data is the timing of starting processing of the frame. In 
this case, discrimination between the special frame header 
401 and the normal frame header 402 should be made by each 
of the devices. The special frame header 401 includes an 
identification bit for distinguishing the special frame 
header from the normal frame header 402. When the 
transmission frame and the special frame header 401 are 
multiplexed as described above, it is not required that the 
special frame header 401 includes specially the frequency 
information or phase information for reproducing the frame 
synchronous signal. 

in the source device 102, when the transmission data 
Td which is transmitted from the sink device 101 is received 
via the transmission line 100a, the processing of outputting 
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the synchronous information included in the special frame 
header 401 in the received predetermined transmission frame 
to the reference signal generator 202bl is performed in the 
controller 201bl. Then, in the reference signal generator 
202bl, the frame synchronous signal as the reference signal 
208bl (figure 4(b)) in processing the video data is 
reproduced on the basis of the synchronous information Is 
from the controller 201bl. 

In a case where the timing of outputting the special 
frame header 401 is the rising or falling timing of the frame 
synchronous signal itself, and when the source device 
receives the special frame header 401 from the sink device 
101 at least once, it can judge the phase of the frame 
synchronous signal with respect to the head of the 
transmission frame on the basis of the timing of receiving 
the head of the transmission frame and the timing of 
receiving the special frame header 401. Therefore, as for 
the transmission frames subsequent to the transmission 
frame including the special frame header 401, the frame 
synchronous signal can be generated on the basis of the 
timing of receiving the head of each transmission frame. 

Then, the timing reference signal 208bl (figure 5(a)) 
generated by the reference signal generator 202bl of the 
source device 102 is output to the first data output unit 
1011 external to the system. Then, in the first data output 



-49- 



• 



unit (camera) 1011 , the image-taking processing is 
performed in synchronization with the timing reference 
signal 208bl from the source device 102, and then the video 
data 205 which is obtained by the image-taking processing 
is output to the source device 102. 

Then, the video data 205 (figure 5(b)) from the data 
output unit 1011 is retained by the controller 201bl of the 
source device 102 . Thereafter, in the controller 201bl , the 
transmission processing of inserting the video data 205 into 
the isochronous data slot 302al of the received transmission 
frame as isochronous data as shown in figure 5(e) and 
transmitting the transmission frame to the transmission 
line 100b is performed. 

When the transmission frame which is transferred from 
the source device 102 is received by the source device 103 
via the transmission line 100b, the controller 201b2 
performs the processing of outputting the synchronous 
information included in the special frame header 4 01 o£ the 
received predetermined transmission frame to the reference 
signal generator 202b2. Then, in the reference signal 
generator 202b2, the frame synchronous signal as the timing 
reference signal 208b2 (figure 4(c) ) in processing the video 
data is reproduced on the basis of the synchronous 
information from the controller 201b2. 

Then, the timing reference signal 208b2 (figure 5(c)) 
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generated by the reference signal generator 202b2 of the 
source device 103 is output to the second data output unit 
1012 external to the system. Then, in the second data output 
unit (camera) 1012/ the image-taking processing is 
performed in synchronization with the timing reference 
signal 208b2 from the source device 103, and the video daLa 
206 which is obtained by the image-taking processing is 
output to the source device 103. 

Then, in the controller 201b2 of the source device 103, 
the video data 206 (figure 5(d)) from the data output unit 
1012 is retained. Thereafter, in the controller 201b2, the 
transmission processing of inserting the video data 206 into 
the isochronous data slot 302a2 of the received transmission 
frame as isochronous data as shown in figure 5(e), and 
transmitting the transmission frame to the transmission 
line 100c is performed. 

When the transmission data (figure 5(e)) which has 
been transferred by the source device 103 is received by 
the sink device 101 via the transmission line 100c, the 
controller 201a performs a processing of copying the 
isochronous data which has been stored in the isochronous 
data slots 302al and 302a2 of the received predetermined 
transmission frame, and outputting the copied isochronous 
data to the video composition device 1020 as the video data 
204al and 204a2 (figures b(f) and 5(g)) from the source 



devices 102 and 103- These two kinds of video data 204al 
and 204a2 are video data 205 and 206 which have been input 
from the first and second data output units to the first 
and second source devices 102 and 103, respectively, in a 
status where their frame synchronization is established. 
Therefore, the frame synchronization of the two kinds of 
video data remains established also when the video data are 
output from the sink device 101 to the video composition 
device 1020. 

Thereafter, in the controller 201a of the sink device 
101, the processing of transferring the transmission frame 
<#n+l) including the normal frame header, the isochronous 
data slot and the asynchronous data slot to the first source 
device 102 is performed. 

As described above, in the data transmission system 
10 of the first embodiment, the sink device 101 performs 
the transmission processing of multiplexing the synchronous 
information which is supplied from the video composition 
device 1020 as the special frame header of the transmission 
frame and the transmission data, and transmitting the 
multiplexed data to the source devices . The source devices 
102 and 103 receives the same special frame header 401 which 
are output by the sink device 101 , and reproduces the timing 
reference signal from the same synchronous information 
included in the received special frame header 401. 
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Therefore, as shown in figures 5(a) and 5(c) , the timing 
reference signals 205 and 206 whose frequency and phase 
coincide each other are output from the reference signal 
generators 202bl and 202b2 o£ Lhe source devices 102 and 
103 to the first and second data output units 1011 and 1012, 
respectively. However, data delay resulting from the 
receipt or transfer in the respective devices, or data delay 
on the transmission lines is ignored. 

Further, in the data transmission system 10 of the 
first embodiment, the frame synchronous signal is output 
as the timing reference signal from the first and second 
source devices 102 and 103 to the first and second data output 
units 1011 and 1012 which are external to the system, 
respectively. Therefore, two kinds of video data which are 
input from the first and second data output units 1011 and 
1012 to the source devices 102 and 103, respectively, are 
in the status where their frame synchronization is 
established. In other words, the two kinds of video data 
are input to the respective controllers 20lbl and 201b2 of 
the source devices 102 and 103 in the status where the frame 
synchronization is established, and output from the source 
devices 102 and 103 to the sink device 101 in the status 
where the frame synchronization is established. 

Consequently, the sink device for receiving plural 
pieces of isochronous data can receive plural pieces of 
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isochronous data in which the frame synchronization is 
established, as the video data from the first and second 
data output units. Thereby, the video data buffer for 
absorbing the gap in processing timings for corresponding 
frames of the two kinds of video data between the sink device 
101 and the video composition device can be dispensed with. 
Further, the data delay from a time when the sink device 
101 receives the plural pieces of video data as the 
isochronous data to a time when the video data are output 
to the video composition device can be avoided. 

in this first embodiment, the description is given of 
a case where the synchronous information for reproducing 
the timing reference signal is transmitted using the special 
frame header 401 of the transmission frame. However, the 
synchronous information can be transmitted using the 
asynchronous data slot 303 or isochronous data slot 302 of 
the transmission frame. 

Hereinafter, a detailed description is given of the 
case where the synchronous information is transmitted using 
the isochronous data slot 302. 

Figures 6(a)-6(c) are diagrams for explaining the 
status of use of the isochronous data slot 302 in a 
predetermined transmission frame <#n). Figure 6(a) shows 
a transmission frame which propagates on the transmission 
line 100a from the sink device 101 to the source device 102. 
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Figure 6(b) shows a transmission frame which propagates on 
the transmission line 100b from the source device 102 to 
the source device 103. Figure 6(c) shows a transmission 
frame which propagates on the transmission line 100c from 
the source device 103 to the sink device 101. 

The predetermined transmission frame (#n) is composed 
of the frame header 301 which indicates the head of the 
transmission frame, an isochronous data slot 302 for 
transmitting isochronous data, and an asynchronous data 
slot 303 for transmission of asynchronous data such as 
control data or status data. 

As shown in figure 3, the isochronous data slot 302 
of the predetermined transmission frame (#n) is divided into 
the first individual data slot 30231, the second individual 

data slot 302a2 and the m-th individual data slot 302am. 

in this case, the first individual data slot 302al is 
allocated to the isochronous data which is transmitted from 
the first source device 102 to the sink device 101, and the 
second individual data slot 302a2 is allocated to the 
isochronous data which is transmitted from the source device 
103 to the sink device 101. 

in addition, an isochronous data 601 which has been 
already transmitted from the source device 102 to the sink 
device 101 is stored in the first individual data slot 302al 
of the transmission frame (#n) transmitted from the sink 
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device 101 to the source device 102 (figure 6(a)). 

A data 602 including the synchronous information 
transmitted from the sink device 101 to the source devices 
102 and 103 is stored in the second individual data slot 
302a2 of the transmission frame (#n) transmitted from the 
sink device 101 to the source device 102 (figure 6(a)). 

An isochronous data 603 which is transmitted from the 
source device 102 to the sink device 101 is stored in the 
first individual data slot 302al of the transmission frame 
(#n) (figure 6(b)) transmitted from the source device 102 
to the source device 103. 

An isochronous data 604 which is transmitted from the 
source device 103 to the sink device 101 is stored in the 
second individual slot 302a2 of the transmission frame (#n) 
(figure 6(c) ) transmitted from the source device 103 to the 

sink device 101. 

Next, a simple description is given of the operation 
of the data transmission system 10 in the case where the 
synchronous information is transmitted using the 
isochronous data slot 302 of the transmission frame. 

in the sink device 101, the processing of inserting 
the data 602 including the synchronous information in the 
second individual data slot 302a2 ot the isochronous data 
slot 302 of the transmission frame, and transmitting the 
transmission frame Lo the source device 102 is performed. 
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In the source device 102, when the transmission frame 
(figure 6(a)) from the sink device 101 is received, a 
processing of reproducing the timing reference signal on 
the basis of the synchronous information included in the 
stored data 602 in the second individual data slot 302a2, 
and outputting the timing reference signal to the first data 
output unit 1011 is performed. In addition, in the source 
device 102, a processing of replacing the isochronous data 
601 which is stored in the first individual data slot 302al 
of the transmission frame with the video data 603 which is 
supplied by the first data output unit 1011, and 
transmitting the transmission frame to the source device 
103 is performed. 

In the source device 103, when the transmission frame 
(figure 6(b)) from the source device 102 is received, a 
processing of reproducing the timing reference signal on 
the basis of the synchronous information included in the 
data 602 stored in the second individual data slot 302a2, 
and outputting the timing reference signal to the second 
data output unit 1012 is performed. In addition, in the 
source device 103, a processing of replacing the data 602 
stored in the second individual data slot 302a2 of the 
transmission frame with the video data 604 which is supplied 
from the second data output unit 1012, and transferring the 
transmission frame to the sink device 101 is performed. 
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In the sink device 101, when the transmission frame 
(figure 6(c)) from the source device 103 is received, a 
processing of obtaining isochronous data 603 and 604 between 
which the frame synchronization is established, from the 
first and second individual data slots 302al and 302a2 in 
the transmission frame is performed. 

When the data transmission system 10 uses the 
isochronous data slot 302 for transmitting the isochronous 
data as the isochronous data transmission slot in cases 
where data are transmitted from the source device to the 
sink device, and uses the isochronous data slot 302 as the 
synchronous information transmission slot in cases where 
data are transmitted from the sink device to the source 
device, plural pieces of isochronous data between which the 
frame synchronization is established by the sink device can 

be obtained. 

in figures 6, the synchronous information is 
transmitted using the isochronous data slot. However, the 
synchronous information can be transmitted using the 
asynchronous data slot 303. Also in this case, plural 
pieces of isochronous data between which the frame 
synchronization is established by the sink device can be 
obtained . 

in this first embodiment, the data transmission system 
in which the sink device 101 transmits the synchronous 
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information to the source devices 102 and 103 is shown. 
However, in the data transmission system 10, one of the two 
source devices can transmit the synchronous information to 
the sink device and the other source device. Also in this 
case, the same effects as those in the first embodiment can 
be obtained. 

In addition, in this first embodiment, the data 
transmission system in which the synchronous information 
generated by the sink device 101 is sequentially transferred 
in the fixed direction between the sink device 101 and the 
source devices constituting the transmission path in the 
form of ring is shown. However, in the data transmission 
system, the synchronous information can be transmitted from 
the sink device directly to each of the source devices . Also 
in this case, the same effects as those in the first 
embodiment can be obtained. 

Further, in this first embodiment, the sink device and 
the source devices constituting the data transmission 
system perform data transmission on the basis of one 
synchronous information. However., in this data 
transmission system, it is possible that plural data 
transmission apparatus (i.e., plural sink devices and 
plural source devices) constituting the data transmission 
system are divided into plural groups and the data 
transmission apparatus included in each of the groups 
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performs data transmission for each group on the basis of 
different synchronous information. 

Further, in this first embodiment, the timing 
reference signal used in the data transmission system is 
a frame synchronous signal which indicates the head of each 
video frame (i.e., indicates the timing of start of signal 
processing for each video frame) . However, when the signal 
processing for each video frame is performed for each of 
blocks which divide a video frame, the timing reference 
signal can be a signal indicating the timing of the signal 
processing for the blocks (block synchronous signal). 

Further, the timing reference signal can be a signal 
which indicates Lhe timing of signal processing for each 
of left and right channels of an audio signal (channel 
synchronous signal). In this case, the signal processing 
for each of the left and right channels of the audio signal 
is performed for each processing unit of the audio signal 
(audio frame)- Therefore, the signal processing for the 
left and right channels can be synchronized by the channel 
synchronous signal for each audio frame. 

Furthermore, in this first embodiment, cameras are 
connected to the source devices, respectively, as the data 
output units external to the system, and the video 
composition device is connected to the sink device as the 
device external to the system. However, the data output 
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unit which is external to the system and connected to the 
source device can be a video transmission device such as 
VTR, and the device which is external to the system and 
connected to the sink device can be a monitor or a display 
device of a navigation system or the like, or a video 
recording device. 

For example, when the data output unit which is 
external to the system and connected to the source device 
is a camera and the device which is external to the system 
and connected to the sink device is a displace device, the 
motor-vehicle-mounted navigation system using real video 
can be realized. In addition, when the data output unit 
which is external to the system and the connected to the 
source device is a camera and the device which is external 
to the system and the connected to the sink device is a video 
recording device, a monitoring camera system or a 
motor-vehicle-mounted drive recorder (a device which 
records video in the case of accidents or robbery) can be 
realized. 

Further, in this first embodiment, no specific example 
of members constituting the transmission line in the data 
transmission system is particularly shown. However, 
optical fibers can be used for the transmission line. 

Furthermore, in this first embodiment, the video data 
which propagate on the transmission lines as isochronous 
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data in the data transmission system can be either non- 
compressed data or data which are compressed by a 
compressive method corresponding to MPEG (Moving Picture 
Experts Group) . 
[Embodiment 2] 

Figure 7 is a diagram illustrating a daLa transmission 
system according to a second embodiment of the present 
invention . 

The data transmission system 20 of the second 
embodiment comprises a first source device 702 for receiving 
a data having high real-time characteristics like audio data 
and video data from a first data output unit 1011 such as 
a camera external to the system and transmitting the data 
as an isochronous data Dtl, and a second source device 703 
for receiving a data having high real-time characteristics 
like audio data and video data from a second data output 
unit 1012 such as a camera external to the system and 
transmitting the data as an isochronous data Dt2. 

in addition, this data transmission system 20 has a 
sink device 701 for receiving the isochronous data Dtl and 
Dt2 which are transmitted from the source devices 702 and 
703, respectively, and outputting the isochronous data Dtl 
and Dt2 to a video composition device 1020 external to the 
system, a first transmission line 700a for transmitting data 
between the sink device 701 and the first source device 702, 
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a second transmission line 700b for transmitting data 
between the first and second source devices 102 and 103, 
and a third transmission line 700c for transmitting data 
between the second source device 103 and the sink device 
101 . 

In this data transmission system 20, the sink device 
701, the first and second source devices 702 and 703 , and 
the first to third transmission lines 700a to 700c 
constitute one data transmission path in the form of a ring. 
In addition, in this data transmission system 20, the 
devices 701 to 703 operate with the same system clock, i.e. , 
with an operational clock of one of the devices 701 to 703 
(for example, the sink device 701), operational clocks of 
other devices (the source devices 702 and 703) are 
synchronized. 

In this second embodiment , identification ID (ID:#1), 
identification ID (101*2), and identification to (ID:#3) 
are set in the devices 701 to 703, respectively, as 
identification IDs for identifying the devices. 

Figure 8(a) is a diagram illustrating a detailed 
structure of the sink device. 

This sink device 701 comprises a controller 801a for 
performing a processing of receiving a transmission data 
Td from the transmission line 700c and a processing of 
transmitting the transmission data Td to the transmission 
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line 700a, and a processing of controlling the video 
composition device 1020 external to the system, a reference 
signal generator 802a for generating a reference signal 
(hereinafter, referred to also as a timing reference signal) 
808a on the basis of synchronous information Is included 
in the received transmission data Td , and a selector switch 
809a for selecting one of the transmission data Td from the 
transmission line 700c and an output data odO from the 
controller 801a in accordance with a control signal CsO from 
the controller and outputting the selected one. 

The timing reference signal 808a is a synchronous 
signal for determining a timing of composing isochronous 
data by the video composition device 1020 for each frame. 
The receiving processing of the controller 801a is a 
processing of receiving the transmission data Td from the 
transmission line 700c and outputting an isochronous data 
804al and 804a2 included in the data to the video composition 
device 1020 external to the system- The transmitting 
processing of the controller 801a includes an output 
processing of outputting a synchronous information 807a 
from the video composition device 1020 to the transmission 
line 700a as a part of the transmission data Td and a transfer 
processing of transferring the transmission data from the 
transmission line 700c as it is to the transmission line 
700a, thereby controlling the selector switch 809a to switch 
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the processing between "the output processing and transfer 
processing in accordance with the control signal CsO. In 
addition, the synchronous information 807a is a frame 
synchronous signal which indicates a timing of composing 
plural pieces of isochronous data by the video composition 
device 1020 for each frame. Further, the control processing 
of the controller 801a is a processing of 

transmitting/receiving an asynchronous data 803a such as 
commands for controlling the video composition device 1020 
to/from the video composition device 1020. 

The selector switch 809a has a first input terminal 
Tla (A end) which is connected to the transmission line 700c, 
a second input terminal Tib (B end) to which the output data 
OdO from the controller 801a is input , and an output terminal 
T2 which is connected to the transmission line 700a, In 
accordance with the control signal CsO from the controller 
801a/ the output terminal T2 is connected to one of the first 
and second input terminals Tla and Tib. 

Here, in this data transmission system 20 of the second 
embodiment, the sink device 701 outputs the synchronous 
information of the data transmission system 20. Therefore, 
a synchronous information output processing in the 
controller 801a of outputting the synchronous information 
Is included in the received transmission data Td to the 
reference signal generator 802a and an operation in the 
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reference signal generator 802a of generating the timing 
reference signal 808a on the basis of the synchronous 
information Is are not required. However, when the source 
device other than the sink device 701 in the data 
transmission system 20 generates the synchronous 
information of the data transmission system 20, the 
synchronous information output processing in the controller 
801a and the operation in the reference signal generator 
802a for generating the timing reference signal 808a are 
performed. 

Figure 8(b) is a diagram illustrating a detailed 
structure of the first source device 702. 

This source device 702 has a controller 801bl for 
performing a processing of receiving a transmission data 
Td from the transmission line 700a, a processing of 
transmitting the transmission data Td to the transmission 
line 700b, and a processing of controlling the first data 
output unit (camera) 1011 external to the system, a 
reference signal generator 802bl for generating a timing 
reference signal 808bl on the basis of the synchronous 
information Is included in the received transmission data 
Td, and a selector switch 809bl for selecting one of the 
transmission data Td from the transmission line 700a and 
an output data Obi from the controller ROlbl in accordance 
with a control signal Csl from the controller and outputting 
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the selected one. 

The timing reference signal 808bl is a synchronous 
signal for determining a timing of outputting video data 
of each frame by the first data output unit 1011. The 
receiving processing of the controller 801bl is a processing 
of receiving the transmission data from the transmission 
line 700a and outputting the synchronous information Is 
included the transmission data to the reference signal 
generator 802bl. In addition, the transmission processing 
of the controller 801bl includes an output processing of 
outputting a video data 805 from the first data output unit 
1011 to the transmission line 700b as a part of the 
transmission data Td (isochronous data) and a transfer 
processing of transferring the transmission data from the 
transmission line 700a as it is to the transmission line 
700b/ and controls the selector switch 809bl to switch the 
processing between the output processing and the transfer 
processing in accordance with the control signal csl. 
Further, the control processing of the controller 801bl is 
a transmitting/receiving an asynchronous data 803bl such 
as a command for controlling the first data output unit 1011 
to/from the first data output unit 1011, 

The selector switch 809bl has a first input terminal 
Tla (A end) which is connected to the transmission line 700a, 
a second input terminal Tib (B end) to which the output data 
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Odl from the controller 801bl is input, and an output 
terminal T2 which is connected to the transmission line 700b. 
In accordance with the control signal Csl from the 
controller 801bl, the output terminal Ts is connected to 
one of the first and second input terminals Tla and Tib. 

In this data transmission system 20 of the second 
embodiment, the sink device 701 generates the synchronous 
information of the data transmission system 20. However , 
when the first source device 702 outputs the synchronous 
information of the data transmission system 20, the 
controller 801bl also performs a processing of transmitting 
the synchronous information 807bl which indicates the 
operation timing from the first data output unit 1011 to 
the transmission line 700b as a part of the transmission 
data Td, in addition to the output processing and the 
transfer processing. To be more specific, the synchronous 
information 807bl indicating the operation timing shows the 
timing of outputting the video data of each frame by the 
first data output unit 1011 to the source device 702. 

Figure 0(c) is a diagram illustrating a detailed 
structure of the second source device 703 . 

The source device 703 comprises a controller 801b2 for 
performing a processing of receiving the transmission data 
Td from the transmission line 700b, a processing of 
transmitting the transmission data Td to the transmission 
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line 700c, and a processing of controlling a second data 
output unit (camera) 1012 external to the system, a 
reference signal generator 802b2 for generating a timing 
reference signal 808b2 on the basis of the synchronous 
information Is included in the received transmission data 
Td, and a selector switch 809b2 for selecting one of the 
transmission data Td from the transmission line 700b and 
an output data Ob2 from the controller 801b2 in accordance 
with the control signal Cs2 from the controller and 
outputting the selected one. 

The timing reference signal 808b2 is a synchronous 
signal for determining a timing of outputting the video data 
of each frame by the second data output unit 1012. The 
receiving processing of the controller 801b2 is a processing 
of receiving the transmission data from the transmission 
line 700b and outputting the synchronous information Is 
included in the transmission data to the reference signal 
generator 802b2- The transmission processing of the 
controller 801b2 includes an output processing of 
outputting a video data 806 from the second data output uniL 
1012 to the transmission line 700c as a part of the 
transmission data Td (isochronous data) and a transfer 
processing of transferring the transmission data from the 
transmission line 700b as it is to the transmission line 
700c, and controls the selector switch 809b2 to switch the 
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processing between the output processing and transfer 
processing in accordance with the control signal Cs2. 
Further, the control processing of the controller 801b2 is 
a processing of transmitting/receiving an asynchronous data 
803b2 such as a command for controlling the second data 
output unit 1012 to/from the data output unit 1012. 

The selector switch 809b2 has a first input terminal 
Tla (A end) which is connected to the transmission line 700b, 
a second input terminal Tib ( B end) to which the output data 
Od2 from the controller 801b2 is input, and an output 
terminal T2 which is connected to the transmission line 700c. 
In accordance with the control signal Cs2 from the 
controller 801b2, the output terminal T2 is connected to 
one of the first and second input terminals Tla and Tib. 

In this data transmission system 20 of the second 
embodiment, the sink device 701 generates the synchronous 
information of the data transmission system 20. However, 
when the source device 703 outputs the synchronous 
information of the data transmission system 20 , a processing 
of transmitting the synchronous information 807b2 which 
indicates the operation timing from the second data output 
unit 1012 to the transmission line 700c as a part of the 
transmission data Td is also performed by the controller 
801b2 as the transmission processing, in addition to the 
output processing and transfer processing- To be more 
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specific, the synchronous information 807b2 indicating the 
operation timing shows the timing of outputting the video 
data of each frame by the second data output unit 1012 to 
the source device 703. 

Figure 9 is a diagram illustrating a data structure 
(transmission frame format) of the transmission data which 
are transmitted to the transmission lines 700a to 700c. 

In the transmission frame 903 as a repetitive unit of 
the data transmission, a predetermined number of groups of 
a transmission/receipt designation packet and a data packet 
are transmitted in a group of a transmission/receipt 
designation packet and the subsequent data packet. In this 
case, the transmission/receipt designation packet is a 
transmission/receipt designation packet which contains 
information for designating a device for transmitting an 
immediately following data packet (transmission source 
device) and a device for receiving this data packet 
(transmission destination packet), in addition, the data 
packet is a packet which contains data which are 
transmitted/received to/from the device designated by 
information stored in the immediately preceding 
transmission/receipt designation packet, which are output 
from the respective devices. Here, the 

transmission/receipt packets 901al to 901ak are the first 
to k-th transmission/receipt designation packets in the 



transmission frame 903 . The data packets 902al to 902ak are 
the first to k-th data packet in the transmission frame 903 . 

Further, the respective transmission/receipt 
designation packets and data packets are transmitted from 
one of the devices 701 to 703. During the period 
corresponding to one frame (frame period) , the 
transmission/receipt designation packet and data packet are 
transmitted at fixed time periods Tc. 

The transmission/receipt designation packet is 
transmitted to the transmission line at a fixed time 
interval as a packet containing NULL information which does 
not designate the transmission source device and the 
transmission destination device even during a time period 
when no isochronous data are output in the frame period. 
That is , the transmission/receipt designation packet is 
transmitted to the transmission line at a fixed time 
interval without interruption for each frame period. 

During each period of the transmission frame, the 
predetermined number of groups of the transmission/receipt 
designation packet and data packet are transmitted with 
taking the transmission/receipt designation packet and the 
data packet as one group, and the transmission frame as a 
unit of the data transmission is repeatedly transmitted. 

Next, the operation of the data transmission system 
20 will be described. 
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In the following description, assume that in the data 
transmission system 20 of the second embodiment the sink 
device 701 transmits the transmission/receipt designation 
packet at predetermined periods. Further, the 
transmission/receipt designation packet 901al designates 
the firsL source device 702 ( ID: #2 ) as the transmission 
device for the data packet 902al, and designates the sink 
device 701 ( id s #1 ) as the receiving device for the data 
packet 902al. In addition/ the transmission/receipt 
designation packet 9 0 1 a 2 des ignates the second source 
device 703 (ID:#3) as the transmission device for the data 
packet 902a2, and designates the sink device 701 (ID:#1) 
as the receiving device of the data packet 902a2. Further, 
the transmission/receipt designation packet 901a3 is a 
packet containing NULL data which does not designate the 
source device or the s ink device . 

Further, the data transmission operation of the data 
transmission system 20 according to the second embodiment 
is an operation for transmitting the video data from the 
first and second data output units (cameras) from the 
corresponding two source devices 702 and 703 to one sink 
device 701, and outputting the two kinds of video data 
received by the sink device to the video composition device 
1020 external to the system. 

Hereinafter, the basic operation of the data 
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transmission system 20 of the second embodiment will be 
described. In this data transmission system 20, the 
respective switches 809a, 809bl and 809b2 of the devices 
701 to 703 are normally in the data transfer status where 
the output terminal T2 is connected to the first input 
terminal Tla (A end). 

In this data transfer status, initially in the sink 
device 701, the selector switch 809a is controlled in 
accordance with the control signal CsO from the controller 
801a so that the transmission line 700a on its output end 
is connected to the output end (B end) of the controller 
801a. Then, the transmission/receipt designation packet 
901al is transmitted from the controller 801a to the 
transmission line 700a via the selector switch 809a. 

At this time, in the selector switches 809bl and the 
809b2 of the source devices 702 and 703 , the output terminals 
T2 is connected to the first input terminal Tla (A end) . 
Therefore, in the source devices 702 and 703 , the processing 
of transferring the transmission/receipt designation 
packet 901al and the processing of receiving the 
transmission/receipt designation packet 901al by the 
controllers 801bl an 801b2 are performed. 

To be more specific, in the first source device 702, 
the transmission/receipt designation packet 901al from the 
sink device 701 is input to the controller 801bl via the 
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transmission line 700a. At the same time, the 
transmission/receipt designation packet 90lal is 
transferred to the third source device 703 via the 
transmission line 700b. In addition, in the second source 
device 703, the transmission/receipt designation packet 
901al from the source device 702 is input to the controller 
801b2 via the transmission line 700b. At the same time, the 
transmission/receipt designation packet 901al is 
transferred to the sink device 701 via the transmission line 
700c. 

In this way, the transmission/receipt designation 
packet 901al output from the sink device 701 passes through 
the transmission line 700a, the first source device 702, 
the transmission line 700b, the second source device 703, 
and the transmission line 700c, and returns to the sink 
device 701 again. At this time, in the selector switch 809a 
of the sink device 701, the output terminal T2 is connected 
to the second input terminal Tib (B end). Therefore, the 
transmission/receipt designation packet 901al is not 
transferred to the source device 702 again, and abandoned 
by the controller 801a of the sink device 701. In the 
selector switch 809a of the sink device 701, the output 
terminal T2 is connected to the first input terminal Tla 
(A end) after the abandonment of the transmission/receipt 
designation packet 901al. 
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In addition, when the transmission/receipt 
designation packet 901al is input to the devices, i.e., the 
sink device 701 and the source devices 702 and 703, the 
controller of each of the devices analyzes the input 
transmission/receipt designation packet 901al and 
thereafter performs the operations in accordance with the 
analysis result- 

Hereinafter, the operation of the controller will be 
mainly described in more detail. Here, the 
transmission/receipt packet 901al transmitted from the sink 
device 701 includes information which designates the first 
source device 702 as the supply source of data and which 
designaLes Lhe sink device 701 as the supply destination 
of data. In addition, the transmission/receipt 
designation packet 901a2 transmitted from the sink device 
701 includes information which designates the source device 
703 as the supply source of data and designates the sink 
device 701 as the supply destination of data* The 
transmission/receipt designation packet 901a3 transmitted 
from the sink device 701 includes NULL information which 
does not designate the source device or sink device. 
(The operation in the cycle of transmitting the first 
transmission/receipt designation packet 901al) 

Initially, the description is given of the operation 
from a time when the first transmission/receipt designation 
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packet 901al is -transmitted from the sink device 701 Lo a 
time when this packet returns to the sink device 701. 

In the sink device 701, the connection status in the 
selector switch 809a is switched in accordance with the 
control signal CsO from the controller 801al- That is, in 
the selector switch 809a, the normal connection status where 
the first input terminal Tla (A end) is connected to the 
output terminal T2 is switched to the data output status 
where the second input terminal Tib (B end) is connected 
to the output terminal T2 . The transmission/receipt 
designation packet 901al which is generated by the 
controller 801a is output to the transmission line 700a via 
the selector switch 809a. 

When the transmission/receipt designation packet 
901al is received by the first source device 702, the 
transmission/receipt designation packet 901al is analyzed 
by the controller 801bl in the first source device 702, as 
well as the transmission/receipt designation packet 901al 
is transmitted to the transmission line 700b via the 
selector switch 809bl - 

Thereafter, in accordance with the analysis result of 
the transmission/receipt designation packet 901al, the 
connection status of the selector switch 809bl is switched 
in accordance with the control signal Csl from the 
controller 801bl. In this case, the transmission/receipt 
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designat.ion packet 901al includes the information which 
designates the first source device 702 as the data supply 
source. Therefore, in the selector switch 809bl, the normal 
connection status where the first input terminal Tla (A end) 
is connected to the output terminal T2 is switched to the 
data output status where the second input terminal Tib (B 
end) is connected to the output terminal T2 in accordance 
with the control signal Csi from the controller 801bl so 
that the output data Odl of the controller 801bl is output 
to the transmission line 700b. Then, the data packet 902al 
which contains video data from the first data output unit 
1011 external to the system is output from the controller 
801bl to the transmission line 700b via the selector switch 
809bl. 

When the transmission/receipt designation packet 
901al transmitted from the first source device 702 is input 
to the second source device 703, the transmission/receipt 
designation packet 901ql is analyzed by the controller 801b2 
in the second source device 703, as well as the 
transmission/receipt designation packet 901al is 
transmitted to the transmission line 700c via the selector 
switch 809b2. In this case, the transmission/receipt 
designation packet 901al does not include the information 
which designates the second source device 703 as the data 
supply source . Therefore, in the selector switch 8 0 9b2 , the 
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normal connection status where the first input terminal Tla 
(A end) is connected to the output terminal T2 is maintained 
in accordance with the control signal Cs2 from the 
controller 801b2. Further, the data packet 902al following 
to the transmission/receipt designation packet 901al is 
transferred to the transmission line 700c via the selector 
switch 809b2. 

When the transmission/receipt designation packet 
901al is input to the sink device 701 via the transmission 
line 700c, the transmission/receipt designation packet 
901al is analyzed by the controller 801a in the sink device 
701. At this time, the selector switch 809a is in the data 
output status where the second input terminal Tib (B end) 
is connected to the output terminal T2 . Therefore, the 
transmission/receipt designation packet 901al from the 
transmission line 700c is not output to the transmission 
line 700a and abandoned. Thereafter, in the selector switch 
809a of the sink device 701, the connection status is 
switched from the data output status to the normal 
connection status in accordance wiLh the control signal CsO 
from the controller 801a. 

When the data packet 902al following to the 
transmission/receipt designation packet 901al is input to 
the sink device 701, the processing according to the 
analysis result of the transmission/receipt designation 
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packet 901al is performed in the controller 801a. To be 
specific, the transmission/receipt designation packet 
90lal includes the information which designates the sink 
device 701 as the data supply destination. Therefore/ in 
the controller 801a/ the isochronous data (video data from 
the first data output unit 1011) which is stored in the data 
packet 902al following to the transmission/receipt 
designation packet 901al is extracted and retained. At this 
time f the selector switch 8091 is in the normal connection 
status where the first input terminal Tla (A end) is 
connected to the output terminal T2 - Therefore, the data 
packet 902al from the transmission line 700c is output to 
the transmission line 700a via the selector switch 809a. 
(The operation in the cycle of transmitting the second 
transmission/receipt designation packet 901a2) 

Next, the operation from the transmission of the 
second transmission/receipt designation packet 90Ia2 from 
the sink device 701, to the receipt of the packet by the 
sink device 701 is described. 

After the first data packet 901al was transmitted , the 
transmission/receipt designation packet 901a2 is generated 
in the controller 801a in the sink device 701, and the 
connection status is switched to the data output status 
where the second input terminal Tib (B end) is connected 
to the output terminal T2 in the selector switch 809a in 
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accordance with the control signal CsO from the controller 
801a. Then, the transmission/receipt designation packet 
901a2 is output to the transmission line 700a via the 
selector switch 809a. 

When the first data packet 902al transmitted from the 
sink device 701 is input to the first source device 702/ 
the data packet 902al is abandoned. At this time, the 
selector switch 809bl is in the data output status where 
the second input terminal Tib (B end) is connected to the 
output terminal T2 . Therefore, the data packet 902al from 
the transmission line /00a is not output to the transmission 
line 700b- Thereafter, in the selector switch 809bl, the 
connection status is switched to the normal connection 
status in accordance with the control signal Csl. 

When the second transmission/receipt designation 
packet 901a2 transmitted from the sink device 701 is input 
to the first source device 702, following to the first data 
packet 902al, the analysis of the transmission/receipt 
designation packet 901a2 is performed by the controller 
801b2 in the first source device 702. In addition, the 
transmission/receipt designation packet 901a2 does not 
include the information which designates the first source 
device 702 as the data supply source. Therefore, in the 
selector switch 809bl, the normal connection status where 
the first input terminal Tla is connected to the output 
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terminal T2 is maintained in accordance with the control 
signal Csl from the controller 801bl. Further, the 
transmission/receipt designation packet 901a2 is 
transmitted to the transmission line 700b via the selector 
switch 809bl. 

when the second transmission/receipt designation 
packet 901a2 is received by the second source device 703, 
the transmission/receipt designation packet 901a2 is 
„ x analyzed by the controller 801b2 in the second source device 

'SI.* 

703, as well as the transmission/receipt designation packet 
901a2 is transmitted to the transmission line 700c via the 

■JA 

selector switch 809a2. 

IU 

Ul Thereafter, the selector switch 809b2 is switched and 

ii 

M controlled in accordance with the control signal Cs2 from 

ITI 

III the controller 801b2, in accordance with the result of the 

£3 analysis of the transmission/receipt designation packet 

901a2. In this case, the transmission/receipt designation 
packet 901a2 includes the information which designates the 
second source device 703 as the data supply source. 
Therefore, in the selector switch 809b2, the connection 
status is switched in accordance with the control signal 
Cs2 from the controller 801b2, to the data output status 
where the output data 0d2 of the controller 801b2 is output 
to the transmission line 7000c. Then, the second data 
packet 902a2 which contains the video data from the second 



data output unit 1012 external to the system is output from 
the controller 801b2 to the transmission line 700c via the 
selector switch 809b2. 

when the second transmission/receipt designation 
packet 901a2 is input to the sink device 701 via the 
transmission line 700c, the analysis of the 
transmission/receipt designation packet 901a2 is performed 
by the controller 801a in the sink device 701 . At this time, 
in the selector switch 809a, the second input terminal Tib 
(B end) is connected to the output terminal T2 . Therefore, 
the second transmission/receipt designation packet 901a2 
from the transmission line 700c is not output to the 
transmission line 700a and abandoned. Thereafter, the 
connection status of the selector switch 809a of the sink 
device 701 is switched from the data output status to the 
normal connection status in accordance with the control 
signal CsO from the controller 801a. 

When the second data packet 902a2 following to the 
second transmission/receipt designation packet 901a2 is 
input to the sink device 701, the processing according to 
the result of the analysis of the transmission/receipt 
designation packet 901a2 is performed by the controller 801a. 
To be specific, the transmission/receipt designation packet 
901a2 includes the information which designates the sink 
device 701 as the data supply source. Therefore, in the 
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controller 801a, the isochronous data stored in the second 
data packet 902a2 following to the second 
transmission/receipt designation packet 901a2 (video data 
from the second data output unit 1012) is extracted and 
retained- At this time, the selector switch 809a is in the 
normal connection status where Lhe first input terminal Tla 
(A end) is connected to the output terminal T2 - Therefore, 
the second data packet 902a2 from the transmission line 700c 
is output to the transmission line 700a via the selector 
switch 809a. 

(The operation in the cycle of transmitting the third 
transmission/receipt designation packet 901a3) 

Next, the operation from the transmission of the third 
transmission/receipt designation packet 901a3 from the sink 
device 701, to the receipt of the packet by the sink device 
701 will be described. 

After the second data packet 902a2 was transmitted, 
the third transmission/receipt designation packet 90la3 is 
generated in the controller 801a of the sink device 701, 
and in the selector switch 809a the connection status is 
switched to the data output status in accordance with the 
control signal CsO from the controller 801a. Then, the 
third transmission/receipt designation packet 901a3 is 
output to the transmission line 700a via the selector switch 
809a . 
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when the second data packet 902a2 transmitted from the 
sink device 701 is input to the first source device 702, 
the data packet 902a2 is transferred to the second source 
device 703. At this time, the selector switch 809bl is in 
the normal connection status where the first input terminal 
Tla (A end) is connected to the output terminal T2 - 
Therefore, the data packet 902a2 from the transmission line 
700a is output to the transmission line 700b. 

When the third transmission/receipt designation 
packet 901a3 transmitted from the sink device 701 is input 
to the first source device 702, following to the second data 
packet 902a2, the analysis of the transmission/receipt 
designation packet 901a3 is performed by the controller 
801b2 in the first source device 702 . As a result of this 
analysis, the transmission/receipt designation packet 
901a3 includes no information which designates the first 
source device 702 as the data supply source. Therefore, in 
the selector switch 809bl, the normal connection status 
where the first input terminal Tla is connected to the output 
terminal T2 is maintained. Accordingly, the 
transmission/receipt designation packet 901a3 is 
transmitted to the transmission line 700b via the selector 
switch 809bl. 

When the second data packet 902a2 transmitted from the 
first source device 702 is input to the second source device 



-85- 



703, the data packet 902a2 is abandoned- At this time, the 
selector switch 809b2 is in the data output status where 
the second input terminal Tib (B end) is connected to the 
output terminal T2 . Therefore, the data packet 902a2 from 
the transmission line 700b is not output to the transmission 
line 700c. Thereafter, in the selector switch 809b2, the 
connection status is switched to the normal connection 
status in accordance with the control signal Cs2- 

When the third transmission/receipt designation 
packet 90 la3 transmitted from the sink device 701 , following 
to the second data packet 902a2 is input to the second source 
device 703, the analysis of the transmission/receipt 
designation packet 901a3 is performed by the controller 
801b2 in the second source device 703 . As a result of the 
analysis, the third transmission/receipt designation 
packet 901a3 includes no information which designates the 
second source device 703 as the data supply source. 
Therefore, in the selector switch 809b2, the normal 
onnection status where the first input terminal Tla is 
ected to the output terminal T2 is maintained in 
accordance with the control signal Cs2 from the controller 
801b2. Further, the third transmission/receipt 
designation packet 901a3 is transmitted to the transmission 
line 700c via the selector switch 809b2. 

When the third transmission/receipt designation 



c 

conn 



-86- 



packet 901a3 is input to the sink device 701 via the 
transmission line 700c, the analysis of the 
transmission/receipt designation packet 901a3 is performed 
by the controller 801a in the sink device 701 . At this time, 
the selector switch 809a is in the data output status where 
the second input terminal Tib (B end) is connected to the 
output terminal T2. Therefore, the third 
transmission/receipt designation packet 901a3 from the 
transmission line 700c is not output to the transmission 
line 700a and abandoned. Thereafter, in the selector switch 
809a of the sink device 701, the data output status is 
switched to the normal connection status in accordance with 
the control signal CsO from the controller 801a. 

Thereafter, in the sink device 701, like the third 
transmission/receipt designation packet 901a3, the 
transmission and receipt of the transmission/receipt 
designation packets 90la4 to 901an containing NULL 
information is performed until one frame period has elapsed. 
These transmission/receipt designation packets 901a4 to 
901an include no information which designates the data 
supply source or data supply destination . Therefore, in any 
of the source devices, generation of data packets 
corresponding to the transmission/receipt designation 
packets 901a4 to 901an is not performed but only transfer 
of the transmission/receipt designation packets 901a4 to 
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901an is performed. 

In the data transmission system 20 of the second 
embodiment, the processing of transmitting 
transmission/receipt designation packets and data packets 
is repeatedly performed for each transmission frame. 
Thereby/ the data transmission is performed between devices 
which are designated by the transmission/receipt 
designation packets. In this case, the video data 805 from 
the first data output unit 1011 and the video data 806 from 
the second data output unit 1012 are transmitted from the 
source devices 702 and 703, respectively, to the sink device 
701 in units of frame. 

Since the interval of transmission of the 
transmission/receipt designation packets is a fixed time 
period, the sizes of the data packets are finite. Therefore, 
when the size of data to be transmitted from one source device 
to the corresponding sink device during one transmission 
frame period, for example the data size of video data of 
one frame to be transmitted from the first source device 
to the sink device is larger than the size of data which 
can be stored in the data packet 902, it is difficult to 
satisfactorily transmit the isochronous data having 
real-time characteristics like video data in this data 
transmission system 20. 

Then, when the isochronous data having a larger data 
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size is to be transmitted, a method of generating a plurality 
of the transmission/receipt designation packets which 
designate the same source device and the same sink device 
in one transmission frame period can be employed. in this 
method, the isochronous data having a larger data size can 
be distributed to plural data packets in one transmission 
frame period, thereby being transmitted- Accordingly, the 
isochronous data having a higher rate can be transmitted 
in one frame period. 

Then, in this data transmission system 20 of the second 
embodiment, when the data transmission operation using the 
above-mentioned transmission/receipt designation packet 
and data packet is to be performed, the inherent synchronous 
information (reference signal information) corresponding 
to the isochronous data which is transmitted using the data 
packet as well as the information which designates the 
source device as the data supply source and the sink device 
as the data supply destination (transmission data 
designation information) is stored in the 

transmission/receipt designation packet, and transmitted. 

Hereinafter, the description is given of the data 
transmission operation for storing the synchronous 
information together with the transmission data designation 
information in the first transmission/receipt designation 
packet, thereby being transmitted. 
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Ill- 



Figure 10(a) shows a transmission data which 
propagates on the transmission lines in the data 
transmission system 20 of the second embodiment. Figures 
10(b) and 10(c) show reference signals which are reproduced 
in the first and second source devices. 

During a predetermined transmission frame period of 
the transmission data Td, the transmission/receipt 
designation packets lOOlal to 100a3 are transmitted at fixed 
time intervals. In addition, following to the 
transmission/receipt designation packet lOOlal, the 
corresponding data packet 1002al is transmitted, and 
following to the transmission/receipt designation packet 
1001a2, the corresponding data packet 1002a2 is 
transmitted . 

Here, the transmission/receipt designation packet 
lOOlal is a special transmission/receipt designation packet 
which includes the transmission data designation 
information designating the first source device 702 as the 
supply source of data stored in the data packet 1002al 
corresponding to the packet lOOlal and designating the sink 
device 701 as the supply destination, as well as the 
synchronous information (reference signal information) 
inherent to the isochronous data. In addition, the 
transmission/receipt designation packet 1001a2 includes 
the transmission data designation information which 
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designates the second source device 703 as the supply source 
of data stored in the data packet 1002a2 corresponding to 
the packet 1001a2, and designates the sink device 701 as 
the supply destination. In addition, the 
transmission/receipt designation packet 1001a3 includes 
NULL information and there is no data packet corresponding 
thereto. 

Further, the synchronous information inherent to the 
isochronous data included in the special 

transmission/receipt designation packet is reproduced by 
the reference signal generator 802bl in the source device 
702 as the reference signal 808bl (figure 10(b))/ and the 
synchronous information is reproduced by the reference 
signal generator 802b2 in the source device 703 as the 
reference signal 808b2 (figure 10(c)). 

Figures ll(a)-ll(f) are diagrams for explaining the 
respective operations of the devices of the data 
transmission system 20. Figure 11(a) shows the reference 
signal 808bl output by the reference signal generator 802bl 
of the source device 702 . Figure 11(b) shows the video data 
805 which is input from the first data output unit 1011 to 
the controller 8 01bl of the source device 702 - Figure 11(c) 
shows the reference signal 808b2 which is output from the 
reference signal generator 802b2 of the source device 703. 
Figure 11(d) shows the video data 806 which is input from 
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the second data output unit 1012 to the controller Q01b2 
of the source device 703. Further, figure 11(e) shows the 
transmission data Td on the transmission line of the data 
transmission system 20, and figure 11(f) and 11(g) show the 
video data 804al and 804a2 which is output from the 
controller 801a of the sink device 701 to the video 
composition device 1020 -(i.e., the video data 805 and 806 
which are output from the first and second data output units) . 
Here, synchronous signals shown in figures 11(a) and 11(c) 
are the same as the synchronous signals as shown in the 
figures 10(b) and 10(c), respectively. 

Initially, the synchronous information 807a is input 
from the video composition device 1020 external to the 
system, to the sink device 701. This synchronous 
information represents a timing signal as a reference of 
a processing of composing two pieces of video data, i.e., 
video data from the first and second data output units 1011 
and 1012 in the video composition device 1020. For example, 
a frame synchronous signal indicating the head of the video 
frame is used as the synchronous information. 

Here, the synchronous information is not limited to 
the frame synchronous signal. It can be any information as 
long as it can reproduce the frame synchronous signal. For 
example, the synchronous information can include frequency 
information which indicates the frequency of the frame 
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synchronous signal and phase information which indicates 
the phase of the frame synchronous signal. Here, the 
frequency information is information which indicates that 
the frame synchronous signal is obtained by X-dividing (X 
is a positive integer) the operational clock of the system, 
or information which indicates the cycle of the frame 
synchronous signal, or the like. The phase information is 
information which indicates the timing of a rising edge or 
falling edge of the frame synchronous signal, or temporal 
information which indicates the phase with respect to the 
rising edge or falling edge, or the like. In addition, as 
the operational clock of the system, an operational clock 
of any of the sink device 701 and the source devices 802 
and 803 in the data transmission system 20, and the video 
composition device 1020 and the first and second data output 
units (cameras) 1011 and 1012 which are external to the 
system is employed . 

when the synchronous information 807a from the video 
composition device 1020 external to the system is input to 
the sink device 7 01, the transmission processing of 
multiplexing the synchronous information and the special 
transmission /receipt designation packet lOOal of a 
predetermined transmission frame and transmitting the 
multiplexed information to the transmission line 700a is 
performed in the controller 801a- The simplest method of 
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multiplexing the synchronous information and the special 
transmission/receipt designation packet 1001a! is a method 
of synchronizing the transmission/receipt designation 
packet lOOlal with the frame synchronous signal and 
multiplexing these data. To be specific, one special 
transmission/receipt designation packet is multiplexed 
every predetermined number of transmission frames at a 
timing of rising or falling of the frame synchronous signal. 
Thereby, it can be seen that the timing of receiving the 
special transmission/receipt designation packet of the 
transmission frame is a timing of starting the processing 
of the frame on the receiving end of the transmission data. 
In this case, each of the devices should distinguish between 
the special transmission/receipt designation packet lOOlal 
and the normal transmission/receipt designation packet 
1001a2. The special transmission/receipt designation 
packet lOOlal includes an identification bit for 
distinguishing this packet lOOlal from the normal 
transmission/receipt designation packet 1001a2. When the 
special transmission/receipt designation packet lOOlal is 
multiplexed in the transmission frame, it is unnecessary 
for the special transmission/receipt designation packet 
lOOlal to particularly include the frequency information 
or phase information for reproducing the frame synchronous 
s ignal . 
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When the special transmission/receipt designation 
packet lOOlal transmitted from the sink device 701 is 
received by the first source device 702 via the transmission 
line 700a, the processing of outputting the synchronous 
information included in the received special 
transmission/receipt designation packet lOOlal to the 
reference signal generator 802bl is performed in the 
controller 801bl. Then, in the reference signal generator 
802bl, the frame synchronous signal as the timing reference 
signal 808bl (figure 10(b)) in processing video data is 
reproduced on the basis of the synchronous information from 
the controller 801a of the sink device 701. 

when the timing of outputting the special 
transmission/receipt designation packet lOOlal is the 
rising or falling timing itself of the frame synchronous 
signal, the source device 702 can know the phase of the frame 
synchronous signal with respect to the head of the 
transmission frame on the basis of the timing of receiving 
the head of the transmission frame and the timing of 
receiving of the special transmission/receipt designation 
packet lOOlal, only when the special transmission/receipt 
designation packet lOOlal from the sink device 701 is 
received at least once- Therefore, for the transmission 
frames subsequent to the transmission frame including the 
special transmission/receipt designation packet lOOlal, 
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the frame synchronous signal can be generated on the basis 
of the timing of receiving the head of each transmission 
frame . 

Then, the timing reference signal 808bl ( figure 11(a) ) 
which is generated by the reference signal generator 802bl 
of the source device 702 is output to the tirst data output 
unit 1011 external to the system. Then, in the first data 
output unit (camera) 1011, an image-taking processing is 
performed in synchronization with the timing reference 
signal 808bl from the source device 702, and the video data 
805 obtained by the image-taking processing is output to 
the source device 702 (figure 11(b)). 

Then, in the controller 801bl of the source device 702 , 
the video data 805 from the data output unit 1011 is retained. 
Thereafter, in the controller 801bl, the transmission 
processing of storing the video data 805 in the data packet 
1102al (data packet 1002al in figure 10(a)) as the 
isochronous data and transmitting the data packet 1102al 
so as to follow the received special transmission/receipt 
designation packet llOlal (transmission/receipt 
designation packet lOOlal in figure 10(a)) to the 
transmission line 700b is performed (figure 11(e)). 

When the special transmission/receipt designation 
packet lOOlal transmitted from the sink device 701 is 
received by the second source device 703 via the 
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transmission line 700b, the processing of outputting the 
synchronous information included in the received special 
transmission/receipt designation packet lOOlal to the 
reference signal generator 802b2 is performed in the 
controller 801b2. Then, in the reference signal generator 
802b2, the frame synchronous signal as the timing reference 
signal 808b2 (figure 10(c)) in processing video data is 
reproduced on the basis of the synchronous information from 
the controller 801a of the sink device 701. 

Then, the timing reference signal 8 0 8b2 (figure 11(c) ) 
generated by the reference signal generator 802b2 of the 
source device 703 is output to the second data output unit 
1012 external to the system. Then, in the second data output 
unit (camera) 1012, an image^taking processing is performed 
in synchronization with the timing reference signal 808b2 
from the source device 703, and the video data 806 obtained 
by the image-taking processing is output to the source 
device 703 (figure 11(d)). 

Then, in the controller 801b2 of the source device 703 , 
the video data 806 from the data output unit 1012 is retained. 
However, the special transmission/receipt designation 
packet lOOlal includes no information which designates the 
second source device 703 as the data supply source. 
Therefore, at a time when the special transmission/receipt 
designation packet lOOlal has been received by the source 
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device 7 0*3, the processing of storing the video data 806 
retained in the controller 801b2 in a data packet and 
outputting the data is not performed. Then, when the 
transmission/receipt designation packet 1002a2 including 
the information which designates the second source device 
703 as the data supply source is received after the receipt 
of the special transmission/receipt designation packet 
lOOlal, the processing of storing the video data 806 
retained in the controller 801b2 in the data packet 1102a2 
(data packet 1002a2 in figure 10(a) ) and outputting the data 
packet 1102a2 subsequent to the transmission/receipt 
designation packet 1102a2 (transmission/receipt 
designation packet 1001a2 in figure 10(a)) is performed 
( figure 11(e)). 

Then, in the sink device 701, the data packet 1002al 
is received subsequent to the special transmission/receipt 
designation packet lOOlal and then the data packet 1002a2 
is received subsequent to the transmission/receipt 
designation packet 1001a2. Then, in the controller 801a, 
the processing of copying isochronous data included in the 
received data packets 1002al and 1002a2 and outputting 
copied isochronous data 804al (figure 11(f)) and 804a2 
(figure 11(g) ) to the video composition device 1020 as the 
video data 805 and 806 from the source devices 702 and 703 
is performed. 



These two kinds of video data are input: from the first 
and second data output units 1011 and 1012 to the first and 
second source devices 702 and 703 in the status where their 
frame synchronization is established. Therefore, when 
these two kinds of video data are output from the sink device 
701 to the video composition device 1020, the frame 
synchronization of these video data is established. 

Here, after the data packet 1002a2 is transmitted from 
each source device, plural transmission/receipt 
designation packets which contain NULL information 6uch as 
the transmission/receipt designation packet 1001a3 are 
transmitted from the sink devices 701. However/ since the 
transmission/receipt designation packet include no data 
transmission information, the processing of transmitting 
data packet subsequent to the transmission/receipt 
designation packet is not performed in each of the source 
devices . 

As described above, in the data transmission system 
20 of the second embodiment, the transmission processing 
of storing the synchronous information which is supplied 
from the video composition device 1020 in the special 
transmission/receipt designation packet lOOlal and 
transmitting the special transmission/receipt designation 
packet lOOlal to the source devices is performed by the sink 
device 701. In the source devices 702 and 703 , the same 
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special transmission/receipt designation packet lOOlal 
which is output from the sink device 701 is received and 
the timing reference signal is reproduced from the 
synchronous information included in the received special 
transmission/receipt designation packet lOOlal. 
Therefore, as shown in figures 11(a) and 11(c), the timing 
reference signals 808bl and 808b2 having the frequency and 
the same phase are output from the reference signal 
generators 802bl and 802b2 of the source devices 702 and 
^1 703 to the first and second data output units 1011 and 1012, 

^ respectively. However, data delay resulting from the 

41 

M receipt or transfer in the respective devices, or data delay 

ill 

ijj- on the transmission line is ignored. 

M- In this data transmission system 20 of the second 

iu 

m. embodiment, the frame synchronous signal is output from the 
*\. first and second source devices 702 and 703 to the first 

'>sa x 

FT 

*" and second data output units 1011 and 1012 external to the 
system as the timing reference signal. Therefore, the two 
kinds of video data which are input from the first and second 
data output units 1011 and 1012 to the source devices 702 
and 703, respectively, are in the status where the frame 
synchronization is established. in other words, the two 
kinds of video data are input to the controllers 801bl and 
80bl2 of the source devices 702 and 703 at the same timing 
and output from the source devices 702 and 703 to the sink 
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device 701 at: the same timing, respectively. 

Consequently, in the sink device receiving plural 
pieces of isochronous data, plural pieces of isochronous 
data having the frame synchronization established can be 
received as the video data from the first and second data 
output units 1011 and 1012. Thereby, a video data buffer 
for absorbing the gap of the processing timing for the 
corresponding frames of two kinds of video data between the 
sink device 701 and the video composition device 1020 is 
dispensed with. Further, data delay from when the sink 
device 701 receives plural pieces of video data as 
isochronous data to when the video data are output to the 
video composition device can be avoided. 

In the data transmission system according to the 
second embodiment, the synchronous information is stored 
in the special transmission /receipt designation packet 
lOOlal to be transmitted. However, in the data transmission 
system, the synchronous information can be stored in a data 
packet together with asynchronous data or isochronous data 
to be transmitted. 

In addition, in this second embodiment, the 
transmiss ion /receipt des ig nation packet designates the 
device for transmitting the immediately following data 
packet and the device for receiving this data packet . 
However, it is possible that a transmission channel and a 
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receiving channel arc previously allocated to each device, 
and that the transmission/receipt designation packet 
designates the transmission channel of the device for 
transmitting the data packet and the receiving channel of 
the device for receiving the data packet. 

Further, in this second embodiment, the description 
is given of the data transmission system in which the sink 
device 701 transmits the synchronous information to the 
source devices 702 and 703, However, in the data 
transmission system 20, one of the two source devices can 
transmit the synchronous information to the sink device and 
the other source device. Also in this case, the same effects 
as those in the second embodiment can be obtained. 

Further, in this data transmission system of the 
second embodiment, the synchronous information generated 
by the sink device 701 is successively transferred in a fixed 
direction to the sink device 701 and the source devices 702 
and 703 which constitute the transmission path in the form 
of a ring. However, the data transmission system can 
transmit the synchronous information from the sink device 
directly to each of the source devices. Also in this case, 
the same effects as those in the second embodiment can be 
obtained . 

Further, according to this second embodiment, the sink 
device and the source devices constituting the data 
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transmission system perform the data transmission on the 
basis of one synchronous information. However, in the data 
transmission system, it i_s possible that plural data 
transmission apparatus constituting the data transmission 
system (i.e. , plural sink devices and plural source devices) 
are divided into plural groups and the data transmission 
apparatus belonging to each of the groups performs the data 
transmission on the basis of different synchronous 
information for each group. 

Further, in the data transmission system according to 
the second embodiment, the transmission/receipt 
designation packet is transmitted every fixed time period. 
However, in the data transmission system, the 
transmission/receipt designation packet can be transmitted 
at arbitrary time intervals. 

Furthermore, in this second embodiment, the timing 
reference signal used in the data transmission system is 
a frame synchronous signal which indicates the head of each 
video frame (i.e., indicates the timing of starting the 
signal processing for each video frame). However, when the 
signal processing for each video frame is performed for each 
of blocks which divide the video frame, the timing reference 
signal can be a signal which indicates the timing of the 
signal processing for each of the blocks (block synchronous 
signal ) . 



-103- 



Further, the timing reference signal can be a signal 
which indicates the timing of the signal processing for each 
of left and right channels of an audio signal (channel 
synchronous signal) . The signal processing for each of the 
left and right channels of the audio signal is performed 
for each processing unit for the audio signal (audio frame) . 
Therefore, the signal processing for each of the left and 
right channels can be synchronized by the channel 
synchronous signal for each audio frame. 

Further, in this second embodiment, the camera is 
connected to each of the source devices as the data output 
unit external to the system, and the video composition 
device is connected to the sink device as the device external 
to the system- However, the data output unit which is 
external to the system and connected to the source device 
can be a video transmission device such as VTR. Or the 
device which is external to the system and connected to the 
sink device can be a monitor, a display device such as a 
navigation system, or a video recording device. 

For example, when the data output unit which is 
external to the system and connected to the source device 
is a camera, and the device which is external to the system 
and connected to the sink device is a display device, a 
motor-vehicle-mounted navigation system with real video can 
be realized. In addition, when the data output unit which 
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is external to the system and connected to the source device 
is a camera, and the device which is external to the system 
and connected to the sink device is a video composition 
device, a monitoring camera system or a motor-vehicle- 
mounted drive recorder (a device for recording video on the 
occurrence of accidents or robbery) can be realized. 

in this second embodiment, specific elements 
constituting the transmission lines of the data 
,«* transmission system are not particularly shown- However, 

optical fibers can be used for these transmission lines. 

: £ 

1; Further, in this second embodiment, the video data 

,^ propagating on the transmission lines as the isochronous 

hi 

y ' s data in the data transmission system can be non-compressed 

data or data which are compressed by a compression method 
hi corresponding to MPEG (Moving Picture Experts Group) - 

O Further, in the data transmission system of the second 

embodiment, the plural devices for performing the data 
transmission, i.e., the sink device 701 and the first and 
second source devices 702 and 703 are connected by the data 
transmission path in the form of a ring- However, the form 
of the transmission path connecting the devices of the data 
transmission system is not limited to that in the second 
embodiment. 

Figure 12 is a diagram illustrating a data 
transmission system in which the connection form of the 
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devices is different from that in the second embodiment. 

In this data transmission system 20a, a sink device 
1201 and first and second source devices 1202 and 1203 are 
connected by a data bus 1200 as a transmission line, as shown 
in f igure 12 . In this case, packets output from the devices 
are received by a predetermined device and thereafter 
disappear. Therefore, there is no need for the devices 1201 
to 1203 to abandon the transmitted packets. Accordingly, 
the selector switches in the devices 701 to 703 in the second 
embodiment are eliminated. 

Figure 13 is a diagram illustrating another example 
of the data transmission system in which the connection form 
of the devices is different from that of the second 
embodiment. 

In this data transmission system 20b, as shown in 
figure 13, data input side transmission lines and data 
output side transmission lines of a sink device 1301 and 
first and second source devices 1302 and 1303 are separated 
using a multi-input-multi-output signal distributor 1310, 
and the respective devices are connected by buses. 

In this data transmission system 20b, transmission 
data which are output from the sink device 1301 and the first 
and second source devices 1302 and 1303 are transmitted to 
the signal distributor 1310 via transmission lines 1301b, 
1302b and 1303b, respectively. The transmission data which 
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are input to the signal distributor 1310 are simultaneously 
output to the sink device 1301 and the first and second source 
devices 1302 and 1303 via the transmission lines 1301a, 
1302a and 1303a, respectively. 

In this case, the sink device 1301 and the first and 
second source devices 1302 and 1303 have the same structures 
as those of the sink device 701 and the first and second 
source devices 702 and 703 of the second embodiment. In 
addition, optical fibers are used as the transmission lines 
1301a to 1303a and 1301b to 1303b, for example. As the 
signal distributor 1310, the multi-input-multi-output star 
coupler is used, for example. 

in this data transmission system 20b, unlike the data 
transmission system 20 of the second embodiment, even when 
part of the transmission lines (for example, the 
transmission line 1301a) is broken, the data transmission 
from the sink device 1301 to the first and second devices 
1302 and 1303 is possible. 

Figure 14 is a diagram illustrating another example 
of the data transmission system having the connection form 
of the devices is different from that in the second 
embodiment. 

In this data transmission system 20c, data input side 
transmission lines and data output side transmission lines 
of first, second and third groups of data transmission 
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apparatus are separated using the multi-input-multi-outpuL 
signal distributor 1310, and the respective groups are 
connected via buses, as shown in figure 14. 

In this case, the first group of data transmission 
apparatus includes a sink device 1401 , a first source device 
1404, and a second source device 1406. In this data 
transmission apparatus group, transmission data which are 
input from the distributor 1310 to the sink device 1401 via 
the transmission line 1401a are output to the first source 
device 1404 via the transmission line 1401b. Transmission 
data from the first source device 1404 are transmitted to 
the second source device 1406 via the transmission line 
1401c. Transmission data output from the second source 
device 1406 are transmitted to the distributor 1310 via the 
transmission line 1401d. 

In addition, the second group of data transmission 
apparatus includes a third source device 1402 and a fourth 
source device 1405. in this data transmission apparatus 
group, transmission data which are input from the 
distributor 1310 to the third source device 1402 via the 
transmission line 1402a are output to the fourth source 
device 1405 via the transmission line 1402b. Transmission 
data output from the fourth source device 1405 are 
transmitted to the distributor 1310 via the transmission 
line 1402c. 



^108- 



The third group of data transmission apparatus 
includes a fifth source device 1403. In this data 
transmission apparatus group, transmission data which are 
input from the distributor 1310 to the fifth source device 
1403 via the transmission line 1403a are transmitted to the 
distributor 1310 via the transmission line 1403b. 

In this case, the sink device 1401 has the same 
structure as the sink device 701 of the second embodiment. 
The source devices 1402 to 1405 have the same structure as 
the source device 702 or 703 of the second embodiment. 
Further, the optical fibers are used as the transmission 
lines 1401a to 1401d / 1402a to 1402c, and 1403a and 1403b, 
and the mult i-input-multi-output optical star coupler is 
used as the signal distributor 1310. 

This data transmission system 20c has one sink device 
1401 and the five source devices 1402 to 1406 . However, in 
the data transmission system as shown in figure 14, one of 
the source devices 1402 to 1406 can be replaced with a sink 
device. Further, the number of sink devices and the number 
of source devices are not limited to fixed numbers as long 
as the data transmission system includes at least one sink 
device and two source devices. 
[Embodiment 3] 

Figure 15 is a diagram illustrating a data 
transmission system according to the third embodiment. 
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The data transmission system 30 of the third 
embodiment comprises a first source device 1502 for 
receiving a data having high real-time characteristics like 
audio data or video data from a first data output unit 1011 
such as a camera external to the system and transmitting 
the data as an isochronous data Dtl, and a second source 
device 1503 for receiving a data having high real-time 
characteristics like audio data or video data from a second 
data output unit 1012 such as a camera external to the system 
and transmitting the data as an isochronous data Dt2 . 

This data transmission system 30 has a sink device 1501 
for receiving the isochronous data Dtl and Dt2 which are 
transmitted from the source devices 1502 and 1502, 
respectively, and outputting the synchronous data Dtl and 
Dt2 to a video composition device 1020 external to the system, 
and a data transmission apparatus 1504 for receiving data 
from a data processing unit 1030 external to the system and 
transmitting the data. In this case, the data processing 
unit 1030 is a device for outputting video data, such as 
a camera and a video reproduction device (VTR) , or a device 
for receiving the video data, such as a video composition 
device and a video display device. In addition, the data 
transmission apparatus 1504 is a source device for 
transmitting video data which are input from the outside 
of the system, or a sink device for receiving video data 
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from a transmission line in the system and outputting the 
video data to the outside of the system. 

The data transmission system 30 has a first 
transmission line 1500a for transmitting data between the 
sink device 1501 and the first source device 1502, a second 
transmission line 1500b for transmitting data between the 
first source device 1502 and the second source device 1503/ 
and a third transmission line 1500c for transmitting data 
between the first source device 1502 and the data 
transmission apparatus 1504. 

in this data transmission system 30, the sink device 
1501, the first and second source devices 1502 and 1503, 
the data transmission apparatus 1504, and the first to third 
transmission lines 1500a to 1500c constitutes one data 
transmission path in the form of a tree. 

According to the third embodiment, identification ID 
(ID:#1), identification ID (ID:#2), identification ID 
(ID:#3), and identification ID (ID:#4) are set in the 
devices 1501 to 1504, respectively, as identification IDs 
for identifying these devices. 

Figure 16(a) is a diagram illustrating a specific 
structure of the sink device. 

This sink device 1501 comprises a controller 1601a for 
performing a processing of receiving transmission data Td 
from the transmission line 1500a, a processing of 
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transmitting transmission data Td to the transmission line 
1500a, a processing of controlling the video composition 
device external to the system and an arbitration processing 
for data transmission, and a reference signal generator 
1602a for generating a reference signal 1608a on the basis 
of synchronous information Is included in the received 
transmission data Td . 

Here, the reference signal 1608a is a frame 
synchronous signal for determining the timing of composing 
the isochronous data for each frame in the video composition 
device 1020. The receiving processing of the controller 
1601a is a processing of receiving the transmission data 
Td from the transmission line 1500a and outputting an 
isochronous data 1604al and 1604a2 included in the data to 
the video composition device 1020 external to the system. 
The transmission processing of the controller 1601a is a 
processing of transmitting synchronous information 1607a 
from the video composition device 1020 to the transmission 
line 1500a as a part of the transmission data Td. This 
synchronous information 1607a is a frame synchronous signal 
for indicating the timing of composing plural pieces of 
isochronous data for each frame in the video composition 
device 1020. Further, the control processing of the 
controller 1601a is a processing of transmitting/receiving 
an asynchronous data 1603a such as commands for controlling 
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the video composition device 1020 to/from the video 
composition device 1020 . The arbitration processing of the 
controller 1601a is a processing of determining to which 
device among the data transmission apparatus connected via 
the transmission lines 1500a to 1500c, i.e., the sink device 
1501, the first and second source devices 1502 and 1503, 
and the data transmission apparatus 1504, the right for data 
transmission is given. 

In this data transmission system 30 of the third 
embodiment, the sink device 1501 outputs the synchronous 
information of the data transmission system 30. Therefore, 
a synchronous information output processing in the 
controller 1601a of outputting the synchronous information 
Is included in the received transmission data Td to the 
reference signal generator 1602a and an operation in the 
reference signal generator 1602a for generating the 
reference signal 1608a on the basis of the synchronous 
information Is are not performed. However, when the source 
device other than the sink device 1501 in the data 
transmission system 30 generates the synchronous 
information of the data transmission system 30, the 
synchronous information output processing in the controller 
1601a and the operation in the reference signal generator 
1602a for generating the reference signal 1608a are 
performed . 
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Figure 16(b) is a diagram illustrating a specific 
structure of the first source device. 

The source device 1502 comprises a controller 1601bl 
for performing a processing of receiving transmission data 
Td from the transmission lines 1500a to 1500c, a processing 
of transmitting the transmission data to the transmission 
lines 1500a to 1500c, a processing of controlling a first 
data output unit (camera) 1011 external to the system, and 
an arbitration processing for the data transmission, and 
a reference signal generator 1602bl for generating a 
reference signal 1608bl on the basis of synchronous 
information Is included in the received transmission data 
Td . 

Here / the reference signal 1608bl is a frame 
synchronous signal for determining the timing of outputting 
video data of each frame in the first data output unit 1011. 
The receiving processing of the controller 1601bl includes 
an output processing of receiving transmission data from 
the transmission line 1500a and outputting the synchronous 
information Is included in the transmission data to the 
reference signal generator 1602bl. Further, the 
transmission processing of the controller 1601b includes 
a processing of transmitting a video data 1605 from the first 
data output unit 1011 to the transmission line 1500b as a 
part of the transmission data Td (isochronous data), and 
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a processing of transferring a transmission data from the 
first source device 1501 to the second source device 1503 
via the transmission line 1500b. The control processing of 
the controller 1601bl is a processing of 
transmitting/receiving an asynchronous data 1603bl such as 
commands for controlling the first data output unit 1011 
to/from the data output unit 1011. 

in this data transmission system 30 of the third 
embodiment, the sink device 1501 generates the synchronous 
information of the data transmission system 30. However, 
when the source device 1502 outputs the synchronous 
information of the data transmission system 30, a processing 
of transmitting synchronous information 1607bl which 
indicates the operational timing from the first data output 
unit 1011 at least to the transmission lines 1500a and 1500b 
as a part of the transmission data Td is also performed by 
the controller 1601bl as the transmission processing, in 
addition to the isochronous data transmission processing. 
Specifically, the synchronous information 1607bl 
indicating the operational timing indicates the timing of 
outputting video data of each frame to the source device 
1502 by the first data output unit 1011. 

Figure 16(c) is a diagram illustrating a specific 
structure of the second source device. 

The source device 1503 comprises a controller 1601b2 
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for performing a processing of receivinq transmission data 
Td from the transmission line 1500b, a processing of 
transmitting the transmission data Td to the transmission 
line 1500b, a processing of controlling the second data 
output unit (camera) 1012 external to the system, and an 
arbitration processing for the data transmission, and a 
reference signal generator I602b2 for generating a 
reference signal I608b2 on the basis of synchronous 
information Is included in the received transmission data 

Td. 

Here, the reference signal 1608b2 is a frame 
synchronous signal for determining the timing of outputting 
video data of each frame in the second data output unit 1012 . 
The receiving processing of the controller 1601b2 is a 
processing of receiving the transmission data from the 
transmission line 1500b and outputting the synchronous 
information Is included in the transmission data to the 
reference signal generator 1602b2. in addition, the 
transmission processing of the controller 1601b2 is a 
processing of transmitting a video data 1606 from the second 
data output unit 1012 to the transmission line 1500b as a 
part of the transmission data Td (isochronous data). The 
control processing of the controller I601b2 is a processing 
of transmitting/receiving an asynchronous data 1603b2 such 
as commands for controlling the second data output unit 1012 
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to/from the second data output unit 1012. 

Figure 17 is a diagram illustrating a data structure 
of transmission data which are transmitted to the 
transmission lines 1500a to 1500c (transmission frame 
format) . 

in the transmission frame 1710 as a repetitive unit 
of the data transmission, various packets 1703 to 1705 are 
transmitted subsequent to a cycle start packet 1701 which 
indicates the head of the transmission frame. 

Here, the cycle start packet 1701 is transmitted by 
one ofthe devices 1501 to 1504 every fixed time period, 
in this data transmission system 30, the cycle start packet 
1701 is transmitted from the sink device 1501 every fixed 
time period. The packets 1703 and 1704 are packets which 
are transmitted from the first and second source devices 
1502 and 1503, respectively, and contains the isochronous 
data (isochronous data packet) - The packet 1705 is a packet 
which is transmitted from the sink device 1501 and contains 
asynchronous data (asynchronous data packet). 

immediately before the transmission of each data 
packet, there is an arbitration period A P which is required 
in the arbitration processing for the data transmission. 
During this period, the arbitration processing for 
determining to which device among plural devices which 
retain data to be transmitted the right to transmit data 
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is given is performed. Therefore, the transmission of the 
data packets from any of the devices is not performed during 
this arbitration period Ap. After the elapse of the 
arbitration period A P , the data packet transmission from 
the device which has acquired the data transmission right 
in the arbitration processing is performed. 

in this data transmission system 30 of the third 
embodiment, the processing of transmitting the various 
packets 1703 to 1705 subsequent: to the cycle start packet 
1701 is repeatedly performed for each transmission frame 
1710. 

Next, the operation of the data transmission system 

30 will be described. 

Hereinafter, as the data transmission operation of the 
data transmission system 30 according to the third 
embodiment, the description is given of an operation for 
transmitting video data from the first and second data 
output units (camera) 1011 and 1012, from the corresponding 
two source devices 1502 and 1503to the one sink device 1501, 
and outputting two kinds of video data received by the sink 
device 1501 to the video composition device 1020 external 
to the system for composing these video data to be displayed, 

Figure 18(a) shows a data structure of data which 
propagate on a transmission line in the data transmission 
system 30 of the third embodiment . Figures 18(b) and 18(c) 
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show how the reference signals are generated in the first 
and second source devices of the system- To be specific, 
when a predetermined asynchronous data packet 1705a which 
is output from the sink device 1501 is received by the first 
source device 1502 via the transmission line 1500a, a timing 
reference signal 1608bl (figure 18(b)) is generated in the 
first source device 1502. In addition, when the 
predetermined asynchronous data packet 1705a is received 
by the second source device 1503 via the transmission line 
1500a, the first source device 1502 and the transmission 
line 1500b, a timing reference signal 1608b2 (figure 18(c)) 
is generated in the first source device 1502. 
ij Next, the operation is described. 

Initially, the synchronous information 1607a is input 
to the sink device 1501 from the video composition device 
1020 external to the system. This synchronous information 
represents a timing signal as the reference of processing 
of composing two kinds of video data, i.e., the video data 
from the first and second data output units 1011 and 1012, 
by the video composition device 1020. For example, a frame 
synchronous signal which indicates the head of a video frame 
is employed as the. synchronous information. 

The synchronous information is not limited to the 
frame synchronous signal. As long as the synchronous 
information can reproduce the frame synchronous signal, any 



information can be used. For example, the synchronous 
information can include the frequency information which 
indicates the frequency of the frame synchronous signal and 
the phase information which indicates the phase of the frame 
synchronous signal. Here, the frequency information is 
information which indicates that the frame synchronous 
signal is obtained by X-dividing (X is a positive integer) 
the operational clock of the system, or information which 
indicates the cycle of the frame synchronous signal, in 
addition, the phase information is information which 
indicates the timing of the rising edge or falling edge of 
the frame synchronous signal, or temporal information which 
indicates the phase with respect to the rising edge or 
falling edge or the like. 

When the synchronous information 1607a from the video 
composition device 1020 external to the system is input to 
the sink device 1501, the processing of storing the 
synchronous information 1607a in an asynchronous data 
packet as an asynchronous data and the arbitration 
processing are performed in the controller 1601a. When the 
data transmission right is obtained in the arbitration 
processing, the processing of transmitting the asynchronous 
data packet 1705a which contains the asynchronous data to 
the source devices 1502 and 1503 is performed. In the 
asynchronous data packet 1705a, control data for 
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controlling the data transmission between the devices or 
status data indicating the status of the devices are also 
included, in addition to the synchronous information 1607a. 
Therefore, the control data or status data are transmitted 
or received as the asynchronous data together with the 
synchronous information. 

in the controller 1601a, the control data or status 
data in the asynchronous data are distinguished from the 
synchronous information which is stored in the same 
asynchronous data packet. The control data or status data 
are accessed as an asynchronous data 1603a between the 
controller 1601a and the video composition device 1020 
external to the system. 

in the first source device 1502, when the asynchronous 
data packet 1705a transmitted from the sink device 1501 is 
received via the transmission line 1500a, the processing 
of outputting the synchronous information included in the 
received packet 1705a to the reference signal generator 
1602bl is performed in the controller 1601bl. Then, in the 
reference signal generator l602bl, a frame synchronous 
signal as the timing reference signal 1608bl (figure 18(b)) 
in processing video data is reproduced on the basis of the 
synchronous information from the controller 1601bl. 

Then, the timing reference signal 1608bl (figure 
19(a)) which is generated by the reference signal generator 
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1602bl of the source device 1502 is output to the first data 
output unit 1011 external to the system. Then, the 
image-taking processing is performed by the first data 
output unit (camera) 1011 in synchronization with the timing 
reference signal 1608bl from the source device 1502, and 
the video data 1605 which is obtained in the image-taking 
processing is output to the source device 1502 (figure 
19(b)). 

Then, in the controller 1601bl of the source device 
1502, the video data 1605 from the data output unit 1011 
is retained. Thereafter, in the controller 1601bl, the 
video data 1605 is stored in an isochronous data packet 1703a 
as the isochronous data. When the data transmission right 
is obtained in the arbitration processing, a processing of 
transmitting the isochronous data packet 1703a which 
contains the video data 1605 to the transmission line 1500a 
as shown in figure 19(e) is performed. In addition, in the 
controller 1601bl, the processing of transmitting the 
asynchronous data packet 1705a to the second source device 
1503 via the transmission line 1500b is performed. 

When the asynchronous data packet 1705a which is 
transmitted from the sink device 1501 is received by the 
second source device 1503 via the transmission line 1500b, 
the processing of outputting the synchronous information 
included in the received packet 1705a to the reference 
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signal generator 1602b2 is performed in the controller 
1601b2. Then, the frame synchronous signal as the timing 
reference signal 1608b2 (figure 18(c)) in processing the 
video data is reproduced by the reference signal generator 
1602b2 on the basis of the synchronous information Is from 
the controller 1601b2. 

Then, the timing reference signal 1608b2 (figure 
19(c) ) which is generated by the reference signal generator 
1602b2 of the source device 1503 is output to the second 
data output unit 1012 external to the system. Then, in the 
second data output unit (camera) 1012, the image-taking 
processing is performed in synchronization with the timing 
reference signal 1608b2 from the source device 1503, and 
the video data 1606 obtained in the image-taking processing 
is output to the source device 1503 (figure 19(d)). 

Then, the video data 1606 from the data output unit 
1012 is retained by the controller 1601b2 of the source 
device 1503- Thereafter, in the controller I601b2, the 
video data 1606 is stored in an isochronous data packet 1704a 
as the isochronous data. When the data transmission right 
is obtained in the arbitration processing, the processing 
of transmitting the isochronous data packet 1704a which 
contains the video data 1606 to the transmission line 1500b 
as shown in figure 19(e) is performed. This isochronous 
data packet 1704a is transmitted to the sink device 1501 
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via the transmission line 1500b, the first source device 
1502/ and the transmission line 1500a. 

When the isochronous data packets 1703a and 1704a are 
received by the sink device 1501, the processing of 
outputting the isochronous data 1604al and 1604a2 (figure 
19(f) and 19(g) ) included in the received data packets 1703a 
and 1704a as the video data 1605 and 1606 from the source 
devices 1502 and 1503 to the video composition device 1020 
is performed in the controller 1601a. 

These two kinds of video data are input from the first 
and second data output units 1011 and 1012 to the first and 
second source devices 1502 and 1503 in the status where their 
frame synchronization is established. Therefore, also 
when the video data are output from the sink device 1501 
to the video composition device 1020, the frame 
synchronization of the two kinds of video data is 
established . 

As described above, the data transmission system 30 
according to the third embodiment has the sink device 1501 
for receiving the video data (isochronous data), and the 
first and second source devices 1502 and 1503 for 
transmitting the video data. In this data transmission 
system 30, only the device which obtains the data 
transmission right in the arbitration performs the data 
transmission with packets. The sink device 1501 stores the 
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synchronous information as the processing reference for the 
received isochronous data in the asynchronous data packet, 
and transmits the asynchronous data packet. The source 
devices 1502 and 1502 transmit the isochronous data in 
synchronization with the synchronous information included 
in the asynchronous data packet from the sink device 1501. 
Therefore, on the side of the sink device which receives 
plural pieces of isochronous data, the plural pieces of 
isochronous data whose processing timings for respective 
frames are synchronized can be obtained. Accordingly, the 
buffer for absorbing the timing gap can be dispensed with. 

In this data transmission system according to the 
third embodiment, the synchronous information is stored in 
the asynchronous data packet and transmitted. However, in 
the data transmission system, the synchronous information 
can be stored in the isochronous data packet and 
transmitted. 

Further, in the data transmission system of the third 
embodiment, the sink device 1501 transmits the synchronous 
information to the source devices 1502 and 1503. However, 
in the data transmission system, one of source devices can 
transmit the synchronous information to the sink device and 

other source devices. 

Further, in the data transmission system of the third 
embodiment, the synchronous information from the sink 



device 1501 is transmitted to the second source device via 
the first source device. However/ in the data transmission 
system, one of plural devices constituting the system can 
transmit the synchronous information directly to other 
devices. Also in this case, the timing reference signal 
having the same frequency and the same timing can be 
generated by each of the devices on the basis of the 
synchronous information. 

Further, in the data transmission system of the third 
embodiment, the sink device and the source devices 
constituting the data transmission system perform the data 
transmission on the basis of one synchronous information. 
However, in this data transmission system, it is possible 
that plural data transmission apparatus (i.e., plural sink 
devices and plural source devices) constituting the system 
are divided into plural groups and that the data 
transmission apparatus included in each of the groups 
performs the data transmission , on the basis of different 
synchronous information for each group. 

Further, in this third embodiment, the timing 
reference signal used in the data transmission system is 
a frame synchronous signal which indicates the head of each 
video frame (i.e., indicates the timing of starting the 
signal processing for each video frame) . However, when the 
signal processing for each video data is performed for each 
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of blocks which divide the video frame, the timing reference 
signal can be a signal which indicates the timing of the 
signal processing for each of the blocks (block synchronous 
signal ) . 

Further, the timing reference signal can be a signal 
which indicates the timing of signal processing for each 
of left and right channels of an audio signal (channel 
synchronous signal) • 

Further, in this third embodiment, the camera is 
connected to each of the source devices as the data output 
unit external to the system, and the video composition 
device is connected to the sink device as the device external 
to the system. However, the data output unit which is 
external to the system and connected to the source device 
can be a video transmission device such as VTR. The device 
which is external to the system and connected to the sink 
device can be a monitor, a display device of a navigation 
system or the like, or a video recording device. 

Further, in this third embodiment, the specific 
structures of the transmission lines constituting the data 
transmission system are not shown- However, the optical 
fibers can be used for the transmission lines. 
[Embodiment 4] 

Figure 20 is a diagram for explaining a data 
transmission system according lo the fourth embodiment, and 
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shows a structure of a sink device of the system. 

The data transmission system of the fourth embodiment 
comprises a sink device 2001 for performing the processing 
of the sink device 1501 as well as a processing of detecting 
a phase difference between the isochronous data 1605 and 
1606 from the source devices 1502 and 1503 , in place of the 
sink device 1501 in the data transmission system 30 of the 
third embodiment. 

The sink device 2001 comprises a controller 2001a for 
performing a processing of receiving a transmission data 
Td from the transmission line 1500a, a processing of 
transmitting the transmission data Td to the transmission 
line 1500a, a processing of controlling the video 
composition device 1020 external to the system and an 
arbitration processing for the data transmission, a 
reference signal generator 2002a for generating a reference 
signal 2008a on the basis of the synchronous information 
Is included in the received transmission data Td, and a phase 
detector 2010 for detecting a phase difference (phase shift) 
between the isochronous data 1605 and 1606 from the source 
devices 1502 and 1503, which are output from the controller 
2001a as video data 2004al and 2004a2, and outputting phase 
difference information Ipd. 

Here, the reference signal 2008a is a frame 
synchronous signal for determining the timing of composing 
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isochronous data for each frame by the video composition 
device 1020. The receiving processing of the controller 
2001a is a processing of receiving transmission data from 
the transmission line 1500a, and outputting the isochronous 
data 1605 and 1606 included in the data to the video 
composition device 1020 external to the system as the video 
data 2004al and 2004a2. 

In addition, the transmission processing of the 
controller 2001a includes a processing of storing 
synchronous information 2007a from the video composition 
device 1020 in an asynchronous data packet and transmitting 
the asynchronous data packet to the transmission line 1500a, 
and a processing of storing the phase difference information 
Ipd from the phase detector 2010 in an isochronous data 
packet or asynchronous data packet and transmitting the data 
packet to the transmission line 1500a. This synchronous 
information 2007a is a frame synchronous signal for 
determining the timing of composing plural pieces of 
isochronous data for each frame by the video composition 
device 1020. Further, the control processing of the 
controller 2001a is a processing of transmitting/receiving 
an asynchronous data 2003a such as commands for controlling 
the video composition device 1020 to/from the video 
composition device 1020 . The arbitration processing of the 
controller 2001a is a processing of acquiring the right to 
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transmit data among the data transmission apparatus 
connected via the transmission lines 1500a to 1500c, i.e-, 
the sink device 2001, the first and second source devices 
1502 and 1503 and the data transmission apparatus 1504. 

In addition, in the source devices 1502 and 1503 of 
the data transmission system according to the fourth 
embodiment, the processing of shifting the timing reference 
signal on the basis of the phase difference information Ipd 
so as to have no phase difference Pd between the two kinds 
of video data 2004al and 2004al which are output from the 
sink device 2001 to the video composition device 1020 is 
performed. 

In the data transmission system of the fourth 
embodiment, the sink device 2001 outputs the synchronous 
information of the data transmission system. Therefore, 
the synchronous information output processing in the 
controller 2001a for outputting the synchronous information 
is included in the received transmission data Td to the 
reference signal generator 2002a, and the operation of the 
reference signal generator 2002a for generating the 
reference signal 2008a on the basis of the synchronous 
information Is are not performed. However, when the source 
device other than the sink device 2001 of the data 
transmission system generates the synchronous information 
of the data transmission system, the synchronous 
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information output processing In the controller 2001a and 
the operation in the reference signal generator 2002a for 
generating the reference signal 2008a are performed. 

Other construction of the data transmission system 
according to the fourth embodiment is the same as that of 
the data transmission system 30 of the third embodiment. 

Figures 21(a) to 21(f) are diagrams illustrating 
input/output signals to/from the sink device and the source 
device in the data transmission system of the fourth 
embodiment . 

The data 2004al as shown in figure 21(a) is a video 
data which is output from the sink device 2001 to the video 
composition device 1020, and the video data 1605 which is 
supplied from the first data output unit 1011 to the source 
device 1502. The data 2004a2 as shown in figure 21(b) is 
a video data which is output from the sink device 2001 to 
the video composition device 1020, and the video data 1606 
which is supplied from the second data output unit 1012 to 
the source device 1503. Here, the video data 2004a2 has a 
phase difference Pd with respect to the video data 2G04a2. 

In addition, the data 1606 as shown in figure 21(d) 
is a video data which is input from the second data output 
unit 1012 to the second source device 1503 in 
synchronization with the frame synchronous signal 1608b2 
as shown in figure 21(c). 
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A data 1606c as shown in figure 21(f) is a video data 
which is input from the second data output unit 1012 to the 
second source device 1503 in synchronization with the frame 
synchronous signal 1608c2 as shown in figure 21(e). 

Here, the frame synchronous signal 1608c2 as shown in 
figure 21(e) is obtained by advancing the phase of the frame 
synchronous signal 1608b2 as shown in figure 21(c) by the 
phase amount corresponding to the phase difference Pd. 

Next, the operation is described. 

In the data transmission system of the fourth 
embodiment, when no phase shift occurs between the two kinds 
of video data 2004al and 2004a2 which are output from the 
controller 2001a of the sink device 2001 to the video 
composition device 1020, the same data transmission 
processing as those in the third embodiment is performed. 

When the phase shift occurs between the two kinds of 
video data 2004al and 2004a2, information Ipd which 
indicates the phase difference detected by the phase 
detector 2010 of the sink device 2001 is transmitted from 
the sink device to the source devices. Then, in a 
predetermined source device, the processing of shifting the 
timing reference signal is performed so as to have no phase 
difference Pd between the two kinds of video data 2004al 
and 2004a2 which are output from the sink device 2001 to 
the video composition device 1020. 
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To be specific, in the controller 2001a of the sink 
device 2001, when the first and second isochronous data 1605 
and 1606 from the transmission line 1500a are received, the 
processing of outputting the first and second isochronous 
data 1605 and 1606 to the video composition device 1020 as 
the video data 2004al and 2004a2 is performed. At this time, 
in the phase detector 2002a, the phase shift between the 
video data 2004al and 2004a2 which are output to the video 
composition device 1020 is detected, and the information 
which indicates the detected phase difference Pd (phase 
difference information) ipd is output to the controller 
2001a . 

Then, in the controller 2001a, the processing of 
storing the phase difference information Ipd input from the 
phase detector 2010 in an isochronous data packet or 
asynchronous data packet and transmitting the data packet 
to the source device via the transmission line 1500a is 
performed . 

When the isochronous data packet or asynchronous data 
packet which contains the phase difference information Ipd 
from the sink device 2001 is received by the source devices 
1502 and 1503, the processing of controlling the reference 
signal generator so that a timing reference signal which 
is generated by the reference signal generator 1602bl or 
I602b2 on the basis of the synchronous information is 




shifted by a phase amount corresponding to the phase 
difference Pd between the video data 2004al and 2004a2 is 
performed in the controllers 1601bl and 1601b2 in accordance 
with the phase difference information Ipd. Only when the 
phase of the video data 2004al or 2004a2 is advanced or 
delayed, the phase difference Pd between these video data 
can be eliminated. Therefore, the processing of shifting 
the timing reference signal is performed normally in one 
of the source devices 1502 and 1503 . 

A simple description is given of a case where the 
processing of shifting the timing reference signal is 
performed by the second source device 1503 . 

In the reference signal generator 1602b2 of the second 
source device 1503, the signal generation processing of 
generating the timing reference signal 1608b2 (figure 
21(c)) on the basis of the synchronous information Is from 
the controller 1601b2 is performed as well as the phase 
adjustment processing of advancing the phase of the timing 
reference signal 1608b2 on the basis of the phase difference 
information Ipd from the controller 1601b2 by a phase amount 
corresponding to the phase difference Pd indicated by the 
information is performed. Consequently, the timing 
reference signal 1606c (figure 21(f)) whose phase is 
advanced by the phase amount Pd with respect to the timing 
reference signal 1608b2 (figure 21(c)) is output from the 
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reference signal generator 1602b2 to the second data output 
unit 1012 . Thereby, the video data 1606c in accordance with 
the timing reference signal 1608c2 is output from the second 
data output unit 1012 at a timing which is previous to the 
timing of outputting the video data 1606 in accordance with 
the timing reference signal 1608b2, by a period 
corresponding to the phase amount Pd. 

Consequently, isochronous data 2004bl and 2004b2 
whose synchronization is established and which are in phase 

-ci if 

11 are output from the sink device 2001 to the video composition 

.| » device 1020 as the video data from the first and second source 

: ? j 
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: M devices 1502 and 1503. 
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hj As described above/ the data transmission system of 

the fourth embodiment comprises the sink device 2001 for 
kH performing the processing of detecting the phase difference 

n'i 

l t\ between the isochronous data 1605 and 1606 from the source 

j * J devices 1502 and 1503 and outputting the phase difference 

information Ipd which indicates the phase difference, 
together with the processing of the sink device 1501, in 
place of the sink device 1501 of the third data transmission 
system of the third embodiment. The source device 1503 
shifts the timing reference signal on the basis of the phase 
difference information Ipd so as to have no phase difference 
Pd between the two kinds of video data 2004al and 2004a2 
which are output from the sink device 2001 to the video 
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composition device 102 0 . Therefore, in the sink device 2 001 , 
the video data whose synchronization is established and 
which are in phase can be output to the video composition 
device 1020 as video data from the two source devices. 

In the data transmission system according to this 
fourth embodiment, the information relating to the phase 
shift (phase difference information) Ipd is stored in the 
asynchronous data packet or isochronous data packet and 
transmitted. However, the phase difference information 

a 

Jj Ipd can be stored in the cycle start packet 1701 and 

4» transmitted. 

Further, the data transmission system of the fourth 

\U 

hj embodiment comprises the sink device 2001 for performing 

the phase detection processing of detecting the phase 

=1 ■ 

U- difference between the isochronous data 1605 and 1606 from 

in 

;Jj the source devices 1502 and 1503 and outputting the phase 

**s i. 

^ difference information Ipd, in place of the sink device 1501 

in the data transmission system of Lhe third embodiment. 
In the source devices 1502 and 1503, the processing of 
shifting the timing reference signal on the basis of the 
phase difference information Ipd is performed. However, 
the data transmission system can have the sink device for 
performing the phase detection processing in addition to 
the processing in the sink device 101 in the data 
transmission system 10 of the first embodiment or the sink 



device 701 in the data transmission system 20 of the second 
embodiment, in place of these sink devices, and one of the 
first and second source device can perform the shift 
processing for the timing reference signal. 

In this case, the phase difference information can be 
transmitted with making the information included in the 
special frame header 401 of the first embodiment or special 
transmission/receipt designation packet lOOlal of the 
second embodiment, for example. 
[Embodiment 5] 

Figure 22 is a block diagram for explaining a data 
transmission system of the fifth embodiment of the present 
invention . 

The data transmission system 50 of the fifth 
embodiment consists of first and second individual 
transmission systems 50a and 50b (hereinafter, simply 
referred to as transmission system), each performing 
transmission of video data. Here, the each of the 
transmission systems 50a and 50b has the same structure as 
the data transmission system 10 of the first embodiment. 

To be specific, the first transmission system 50a 
comprises a first source device 2203 for receiving a data 
2205 having high real-time characteristics like audio data 
or video data from a first data output unit 1051 such as 
a camera external to the system and transmitting the data 
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as an isochronous data Dtl, and a second source device 2204 
for receiving a data 2206a having high real-time 
characteristics like audio data or video data from a second 
data output unit 1052 such as a camera external to the system 
and transmitting the data as an isochronous data Dt2. 

The transmission system 50a further has a first sink 
device 2201 for receiving the isochronous data Dtl and Dt2 
transmitted from the source devices 2203 and 2204 and 
outputting the isochronous data Dtl and Dt2 to a video 
composition device 1050 external to the system, a first 
transmission line 2200a for transmitting data between the 
sink device 2201 and the first source device 2203, a second 
transmission line 2200b for transmitting data between the 
first and second source devices 2203 and 2204, and a third 
transmission line 2200c for transmitting data between the 
second source device 2204 and the sink device 2201. 

In this transmission system 50a, the sink device 2201 , 
the first and second source devices 2202 and 2203, and the 
first to third transmission lines 2200a to 2200c constitute 
one data transmission path in the form of a ring. 

The second transmission system 50b comprises a third 
source device 2205 for receiving a data 2207a having high 
real-time characteristics like audio data or video data from 
a third data output unit 1053 such as a camera external to 
the system and transmitting the data as an isochronous data 
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Dt3, and a fourth source device 2206 for receiving a data 
2208a having high real-time characteristics like audio data 
or video data from a fourth data output unit 1054 such as 
a camera external to the system and transmitting the data 
as an isochronous data Dt4 . 

This transmission system 50b further comprises a 
second sink device 2202 for receiving the isochronous data 
Dt3 and Dt4 transmitted from the source devices 2205 and 
2206 and outputting the isochronous data Dt3 and Dt4 to the 
video composition device 1050 external to the system, a 
fourth transmission line 2200d for transmitting data 
between the second sink device 2202 and the third source 
device 2205, a fifth transmission line 2200e for 
transmitting data between the third and fourth source 
devices 2205 and 2206, and a sixth transmission line 2200f 
for transmitting data between the fourth source device 2206 
and the second sink device 2202. 

In the transmission system 50b, the sink device 2202, 
the third and fourth source devices 2205 and 2206, and the 
fourth to sixth transmission lines 2202d to 2200f constitute 
one data transmission path in the form of a ring. 

Further, in the data transmission system 50, the 
devices 2201 to 2206 operate with the same system clock, 
i.e., with the operational clock of one of these devices 
2201 to 2206 (for example, the sink device 2201), 
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operational clocks of other devices 2202 to 2206 are 
synchronized* 

Here, the first and second sink devices 2201 and 2202 
have the same structure as the sink device 101 of the first 
embodiment. To be specific, the sink devices 2201 performs 
a processing of transmitting synchronous information 2211 
from the video composition device 1050 to the devices 2203 
and 2204- The sink device 2202 performs a processing of 
transmitting the synchronous information 2211 from the 
video composition device 1050 to the source devices 2205 
and 2206, and a processing of receiving video data 
transmitted from the source devices 2205 and 2206 and 
outputting the video data to the video composition device 
1050. 

Further, the first and third source devices 2203 and 
2205 have the same structure as the sink device 102 of the 
first embodiment. To be specific, the source devices 2203 
and 2205 perform a processing of generating timing reference 
signals 2208bl and 2208b3 on the basis of the synchronous 
information 2211 from the first and second sink device 2201 
and 2202 and outputting the timing reference signals 2208bl 
and 2208b3 to the first and third data output unit 1051 and 
1053 , and a processing of receiving video data 2205 and 2207 
which are output from the first and third data output units 
1051 and 1053 on the basis of the timing reference signals 
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2208bl and 2208b3 and outputting the video data 2205a and 
2207a to the transmission lines 2200b and 2200e. 

In addition, the second and fourth source devices 2204 
and 2206 have the same structure as the source device 103 
of the first embodiment. To be specific, the second and 
fourth source devices 2204 and 2206 perform a processing 
of generating timing reference signals 2208b2 and 2208b4 
on the basis of the synchronous information 2211 from the 
first and second sink devices 2201 and 2202 and outputting 
the timing reference signals 2208b2 and 2208b4 to the second 
and fourth data output units 1052 and 1054 , and a processing 
of receiving video data 2206a and 2208a which are output 
from the second and fourth data output units 1052 and 1054 
on the basis of the timing reference signals 2208b2 and 
2208b4 and outputting the video data 2206 and 2208 to the 
transmission lines 2200c and 2200f. 

In figure 22, asynchronous data such as a control 
command which is accessed between the first and second sink 
devices 2201 and 2202 and the video composition device 1050, 
and a reference signal which is output from the sink device 
2201 to the video composition device 1050 are not shown. 
Further, in figure 22, asynchronous data such as a control 
command which is accessed between the first to fourth source 
devices 2203 to 2206 and the first to fourth data output 
units 1051 to 1054, and synchronous information which is 
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output from the first to fourth data output units 1051 to 
1054 to the first to fourth source devices 2203 to 2206 are 

not shown. 

Next, the operation will be described. 

In the first and second transmission systems 50a and 
50b constituting the data transmission system 50 of the 
fifth embodiment, the data transmission processing is 
performed in the same manner as in the data transmission 
system 10 of the first embodiment. 

Initially, the data transmission in the first 
transmission system 50a is described. 

When the synchronous information 2211 from the video 
composition device 1050 is input to the first sink device 
2201 of the first transmission system 50a, the processing 
of storing the synchronous information 2211 in a special 
frame header of a predetermined transmission frame and 
transmitting the special frame header to the transmission 
line 2200a is performed in the sink device 2201. When the 
special frame header on the transmission line 2200a is input 
to the first source device 2203, the processing of 
generating the timing reference signal 2208bl on the basis 
of the synchronous information 2211 included in the special 
frame header and outputting the timing reference signal to 
the first data output unit 1051 is performed in the first 
source device 2203. 
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When the video data 2205a which is output from the first 
data output unit 1051 in accordance with the timing 
reference signal is received by the first source device 2203 , 
a processing of inserting the video data 2205a into an 
isochronous data slot of a predetermined transmission frame 
and transmitting the isochronous data slot to the 
transmission line 2200b is performed in the first source 
device 2203 . 

When the predetermined special frame header from the 
transmission line 2200b is input to the second source device 
2204/ the processing of generating the timing reference 
signal 2208b2 and outputting the timing reference signal 
2208b2 to the second data output unit 1052 and the processing 
of transmitting the video data 2206a which is output from 
the second data output unit 1052 on the basis of the timing 
reference signal to the transmission line 2200c are 
performed in the second source device 2204/ as in the first 
source device 2203. 

In the first sink device 2201 , when the video data 2205a 
and 2206a from the source devices are received via the 
transmission line 2200c/ a processing of copying the data 
and outputting the data to the video composition device 1050 
is performed. 

Next, the data transmission in the second transmission 
system 50b is described. 
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When the synchronous information 2211 from the video 
composition device 1050 is input to the second sink device 
2202 of the second transmission system 50b, the processing 
of storing the synchronous information in a special frame 
header of a predetermined transmission frame and 
transmitting the special frame header to the transmission 
line 2200d is performed in the sink device 2202. When the 
special frame header from the transmission line 2200d is 
input to the third source device 2205, the processing of 
generating a timing reference signal 2208b3 on the basis 
of the synchronous information included in the special frame 
header and outputting the timing reference signal to the 
third data output unit 1053 is performed in the third source 
device 2205. 

When the video data 2207a which is output from the third 
data output unit 1053 on the basis of the timing reference 
signal is received by the third source device 2205, a 
processing of inserting the video data 2207a into an 
isochronous data slot of the predetermined transmission 
frame and transmitting the isochronous data to the 
transmission line 2200e is performed in the third source 
device 2205. 

When the predetermined special frame header from the 
transmission line 2200e is input to the fourth source device 
2206 , a processing of generating the timing reference signal 
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2208b4 and outputting the timing reference signal to the 
fourth data output unit 1054 and a processing of 
transmitting the video data 2208a which is output from the 
fourth data output unit 1054 on the basis of the timing 
reference signal to the transmission line 2200f are 
performed in the fourth source device 2206, as in the third 

source device 2205 • 

Then, when the video data 2207a and 2208a from the 
source devices are received by the second sink device 2202 
via the transmission line 2200f, a processing of copying 
the data an outputting the data to the video composition 
device 1050 is performed in the second sink device 2202. 

Consequently, from the source devices 2203 and 2204 
included in the first transmission system and the source 
devices 2205 and 2206 included in the second transmission 
system which is different from the first transmission system, 
the video data between which the frame synchronization is 
established, which are output from the corresponding data 
output units are output to the transmission lines 2200c and 
2200f. Then, in the video composition device 1050, a 
processing of composing these video data 2205a to 2208a 
using the video data from the transmission lines 2200c and 

2200f is performed. 

as described above, the data transmission system of 
the fifth embodiment comprises the first transmission 
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system 50a which has the first sink device 2201 and the first 
and second source devices 2203 and 2204, and in which the 
video data 2205a and 2206a transmitted from the first and 
second source devices 2203 and 2204 are received by the first 
sink device 2201, and the second transmission system 50b 
which has the second sink device 2202 and the third and fourth 
source devices 2205 and 2206, and in which the video data 
2207a and 2208a transmitted from the third and fourth source 
devices 2205 and 2206 are received by the second sink device 
2202 . In each of the transmission systems 50a and 50b, the 
data transmission is performed on the basis of the 
synchronous information from the video composition device 
1050 . Therefore, the video data 2205a and 2206a transmitted 
from the first transmission system 50a to the video 
composition device 1050 and the video data 2207a and 2208a 
transmitted from the second transmission system 50b to the 
video composition device 1050 are video data having the 
frame synchronization established. In the video 
composition device 1050, the composition processing can be 
performed directly to the video data which are input from 
the transmission lines 2200c and 2200f of the respective 
transmission systems. 

According to the fifth embodiment, in the data 
transmission system having plural independent individual 
transmission systems, Lhe individual transmission systems 
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constituting the system have the same structure as the data 
transmission system of the first embodiment „ However, the 
individual transmission system can have the same structure 
as the data transmission system of the second embodiment, 
the data transmission system of the third embodiment/ or 
the data transmission system of the fourth embodiment- 

For example, when the plural individual transmission 
systems constituting the data transmission system have the 
same structure as the data transmission system of the second 
embodiment, the synchronous information is stored in the 
special transmission/receipt designation packet and 
transmitted in each of the individual transmission systems. 
When the plural individual transmission systems 
constituting the data transmission system have the same 
structure as the data transmission system of the third 
embodiment, the synchronous information is stored in the 
asynchronous data packet or the isochronous data packet and 
transmitted in each of the individual transmission systems. 
When the plural individual transmission system constituting 
the data transmission system have the same structure as the 
data transmission system of the fourth embodiment, the sink 
devices 2201 and 2202 comprise the phase detector for 
detecting the phase shift ot the received plural isochronous 
data, and store the information relating to the phase shift 
detected by the phase detector from the sink devices 2201 
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and 2202 to the source devices 2203 to 2206 in the 
asynchronous data packet or isochronous data packet and 
transmit the data packet, respectively. The respective 
source devices modify the reproduction timing of the frame 
reference signal on the basis of the information relating 
to the received phase shift. 

According to the fifth embodiment, in the individual 
transmission systems of the data transmission system, the 
plural data transmission apparatus (sink device and source 
devices) constituting the system are connected in the form 
of a ring, i.e., of a ring form connection type. However, 
in the individual transmission systems in the data 
transmission system, the plural data transmission apparatus 
constituting the system can be connected via buses, i.e., 
of a bus connection type. Or, as shown in the third 
embodiment, one data transmission apparatus can be 
connected to other plural data transmission apparatus, i.e. , 
the plural data transmission apparatus constituting the 
system can be of a tree connection type. 

in this fifth embodiment, the respective individual 
transmission systems constituting the data transmission 
system have one sink device and two source devices which 
are connected via the transmission lines. However, the 
individual transmission systems in the data transmission 
system can have one sink device and one source device which 
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are connected in one-to-one relationship. 
[Embodiment 6] 

Figure 23 is a block diagram for explaining a data 
transmission system according to the sixth embodiment. 

The data transmission system 60 of the sixth 
embodiment consists of first and second individual 
transmission systems 60a and 60b which independently 
perform transmission of video data, respectively. In each 
of the individual transmission systems 60a and 60b, two data 
transmission apparatus constituting the system are 
connected in one-to-one relationship. 

to be specific, the first individual transmission 
system 60a comprises a first source device 2312 for 
receiving a data 2321 having high real-time characteristics 
like audio data or video data from a first data output, unit 
1011 such as a camera external to the system and transmitting 
the data as an isochronous data Dtl, and a first sink device 
2310 for receiving the isochronous data Dtl transmitted from 
the source device 2312 and outputting the isochronous data 
Dtl to a video composition device 1020 external to the system. 
The individual transmission system 60a further comprises 
first and second transmission lines 2300 and 2301 for 
transmitting data between the first sink device 2310 and 
the first source device 2312- 

The first transmission line 2300 is a transmission 
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line for transmitting data from the first sink device 2310 
to the first source device 2312, and a low-speed 
transmission line in which high-speed data transmission is 
impossible. Therefore, a data transmission unit of the 
first, sink device 2310 and a data receiving unit of the first 
source device 2312 conform to low-speed data transmission. 
The second transmission line 2301 is a transmission line 
for transmitting data from the first source device 2312 to 
the first sink device 2310, and a high-speed transmission 
line in which high-speed data transmission is possible. 
Therefore, a data receiving unit of the first sink device 
2310 and a data transmission unit of the first source device 
2312 conform to high-speed data transmission. 

The second individual transmission system 60b 
comprises a second source device 2313 for receiving a data 
2323 having high real-time characteristics like audio data 
or video data from the second data output unit 1012 such 
as a camera external to the system and transmitting the data 
as an isochronous data Dt2, and a second sink device 2311 
for receiving the isochronous data Dt2 transmit ted from the 
source device 2313 and outputting the isochronous data Dt2 
to the video composition device 1020 external to the system. 
The individual transmission system 60b further comprises 
third and fourth transmission lines 2302 and 2303 for 
transmitting data between the second sink device 2311 and 
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the second source device 2313. 

The third transmission line 2302 is a transmission 
line for transmitting data from the second sink device 2311 
to the second source device 2313, and a low-speed 
transmission line in which high-speed data transmission is 
impossible. Therefore, a data transmission unit of the 
second sink device 2311 and a data receiving unit of the 
second source device 2313 conform to low-speed data 
transmission. In addition, the fourth transmission line 
2303 is a transmission line for transmitting data from the 
second source device 2313 to the second sink device 2311, 
and a high-speed transmission line in which high-speed data 
transmission is possible. Therefore, a data receiving unit 
of the second sink device 2311 and a data transmission unit 
of the second source device 2313 conform to high-speed data 
transmission. 

To be specific, the relationship between the maximum 
data transmission speed X (Mbps) of the low-speed 
transmission lines 2300 and 2302 and the maximum data 
transmission speed Y (Mbps) of the high-speed transmission 
lines 2301 and 2303 is shown as X<Y . For example, the 
-transmission speed X is 5 Mbps and the transmission speed 

Y is 5 0 Mbps. 

Further, the first and second sink devices 2310 and 
2311 have the same structure as the sink device 101 of the 
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f irst embodiment. To be specific, the sink devices 2310 and 

2311 perform the processing of storing synchronous 
information 2330 from the video composition device 1020 in 
a special frame header and transmitting the special frame 
header to the transmission lines 2300 and 2302 and the 
processing of receiving video data transmitted from the 
source devices 2312 and 2313 and outputting the video data 
to the video composition device 1020/ respectively. 

Further, the first and second source devices 2312 and 
2313 have the same structure as the source device 102 of 
the first embodiment. To be specific, the source devices 

2312 and 2313 perform the processing of generating timing 
reference signals 2320 and 2322 on the basis of the 
synchronous information from the first and second sink 
devices and outputting the timing reference signals to the 
first and second data output units 1011 and 1012, and the 
processing of receiving the video data 2321 and 2323 output 
from the first and second data output units on the basis 
of the timing reference signals 2320 and 2322, storing the 
data in isochronous data slots and transmitting the 
isochronous data slots to the transmission lines 2301 and 
2303, respectively^ 

Figures 24(a) to 24(c) are diagrams illustrating a 
data structure of transmission data which arc transmitted 
to the transmission lines 2300 to 2303 (transmission frame 
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f ormat ) . 

As shown in figure 24(a), transmission frames ( #1 ) Tdl , 
(#2) Td2, (#3) Td3, ... are transmitted on each of the 
transmission lines in a fixed cycle. 

As shown in figure 24(b), on the low-speed 
transmission lines 2300 and 2302, an asynchronous data slot 

2402 which contains an asynchronous data 2404 is transmitted 
subsequent to a frame header 2401 for detecting the head 
of the transmission frame. This asynchronous data slot 2402 
can be previously allocated to a device for transmitting 
the asynchronous data (first or second sink device). Or, 
the respective devices (first and second sink devices) can 
use the asynchronous data slot 2402 as needed. 

As shown in figure 24(c), on the high-speed 
transmission lines 2301 and 2303, an isochronous data slot 

2403 which contains an isochronous data 2405 and the 
asynchronous data slot 2402 which contains the asynchronous 
data 2404 are transmitted subsequent to a frame header 2401 
for detecting the head of the transmission frame. The 
isochronous data slot 2403 is previously allocated to the 
source devices 2312 and 2313 for transmitting isochronous 
data. Further, the asynchronous data 2404 includes a 
control command from the sink device to the source device, 
a response signal for the control command from the source 
device to the sink device (ACK, NACK or the like), status 
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data (data indicating the status of each device) or the like. 
Further, the isochronous data 2405 is a video data from the 
data output unit or the like. 

As described above, in the data transmission system 
60 of the sixth embodiment, from the sink device to the source 
device, only the asynchronous data can be transmitted. On 
the other hand, from the source device to the sink device, 
the isochronous data and asynchronous data can be 
transmitted. The data structure of the transmission frame 
which is used in this data transmission system is 
fundamentally the same as in the first embodiment . However , 
this sixth embodiment is different from the first embodiment 
in that the asynchronous data slot 2403 is not included in 
the transmission frame which is used for the data 
transmission from the sink device 2310 to the source device 
2313 and the transmission frame which is used for the data 
transmission from the sink device 2311 to the source device 
2313 . 

Further, the data transmission speed of the low-speed 
transmission line is different from that of the high-speed 
transmission line. Therefore, the sizes on the temporal 
axis of the frame header 2401 of the transmission frame 
corresponding to the high-speed transmission line, the 
asynchronous data slot 2402 and the asynchronous data 2404 
are smaller than those on the temporal axis of the frame 
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header 2401 of the transmission frame corresponding to the 
low-speed transmission line, the asynchronous data slot 
2402 and the asynchronous data 2404. As described above, 
in this data transmission system 60 of the sixth embodiment, 
the period for transmitting the isochronous data from the 
source device to the sink device is ensured in the 
transmission frame from the source device to the sink device 
with utilizing the difference in the speed between the 
transmission speed from the source device to the sink device 
and the transmission speed from the sink device to the source 
device- Thereby, the cycle of the transmission frame 
transmitted from the sink device to the source devjce is 
made equal to the cycle of the transmission frame 
transmitted from the source device to the sink device. 
Next, the operation is described. 

In the respective transmission systems 60a and 60b of 
the data transmission system 60 according to the sixth 
embodiment, the transmission of the synchronous information 
from the sink devices 2310 and 2311 to the source devices 
2312 and 2313 is performed using the low-speed transmission 
lines 2300 and 2302 , and the transmission of the video data 
(isochronous data) from the source devices 2312 and 2313 
to the sink devices 2310 and 2311 is performed using the 
high-speed transmission lines 2301 and 2303. 

To be specific, when the synchronous information 2330 
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from the video composition device 1020 is input to the first 
sink devices 2310 and 2311 of the first and second individual 
transmission systems 60a and 60b, a processing of inserting 
the synchronous information in the asynchronous data slot 
2402 subsequent to the frame header 2401 of the 
predetermined transmission frame and transmitting the 
asynchronous data slot 2402 to the low-speed transmission 
lines 2300 and 2303 is performed in the sink devices 2310 
and 2311. When the synchronous information from the 
transmission lines 2300 and 2302 is input to the first and 
second source devices 2312 and 2313, a processing of 
generating the timing reference signals 2320 and 2322 which 
have the same frequency and the same phase on the basis of 
the synchronous information and outputting the timing 
reference signals to the first and second data output units 

1011 and 1012 is performed in the respective source devices 
2312 and 2313. Here, the timing reference signals 2320 and 
2322 have the same frequency and the same phase. To be 
specific, the timing reference signals are frame 
synchronous signals which indicate the start timing of the 
processing for each video frame. 

The video data (isochronous data) 2321 and 2323 are 
output from the first and second data output units 1011 and 

1012 in synchronization with the timing reference signals, 
and input to the first and second source devices 2312 and 
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2313 in the status where the frame synchronization is 
established, respectively. 

In the first source device 2312, the input isochronous 
data 2321 is retained and thereafter a processing of 
inserting the isochronous data 2321 to the isochronous data 
slot 2403 following to the frame header 2401 of the 
predetermined transmission frame, inserting the 
synchronous information 2404 from the sink device into the 
asynchronous data slot 2402 following to the isochronous 
data slot 2403, and transmitting the isochronous data and 
synchronous information to the high-speed transmission line 
2301 is performed. To be specific, in the first source 
device 2312, the video data 2321 is transferred to the first 
sink device 2310 as well as the received synchronous 
information 2404 is returned to the first sink device 2310. 

Similarly, in the second source device 2313, the input 
isochronous data 2323 is retained and thereafter a 
processing of inserting the isochronous data 2323 into the 
isochronous data slot 2403 following to the frame header 
2401 of the predetermined transmission frame, inserting the 
synchronous information 2404 from the sink device into an 
asynchronous data slot 2402 following to the isochronous 
data slot 2403, and transmitting the isochronous data and 
the synchronous information to the high-speed transmission 
line 2303 is performed. To be specific, in the second source 
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device 2313, the video data 2323 is transferred to the second 
sink device 2311 as well as the received synchronous 
information 2404 is returned to the second sink device 2311 . 

Then, in the first and second sink devices 2310 and 
2311, the isochronous data 2405 stored in the isochronous 
data slot 2403 of the transmission frame, which are received 
via the high-speed transmission line 2301 and 2303 are 
output to the video composition device 1020 as the 
respective video data 2331 and 2333. These video data 2331 
and 2333 are input from the first and second data output 
units to the first and second source devices 2312 and 2313 
in the status where the frame synchronization is established, 
respectively. Therefore, the frame synchronization is 
established also at the output timing of the sink devices 

2310 and 2311. 

The video data 2405 received by the sink devices 2310 
and 2311 are abandoned after the receipt by the sink devices 
2310 and 2311, and not transferred to the source devices 
2312 and 2313 via the low-speed transmission lines. In 
addition, the asynchronous data 2402 which have been 
returned from the source devices 2312 and 2313 to the sink 
devices 2310 and 2311 are also abandoned like the video data 
2405 after these data are received by the sink devices 2310 
and 2311, respectively. 

As described above, the data transmission system 60 
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of the sixth embodiment comprises a first individual 
transmission system 60a which has the first sink device 2310 
and the first source device 2312 and in which these devices 
are connected by the two transmission lines 2300 and 2302 
having different transmission speeds in one-to-one 
relationship, and a second individual transmission system 
60b which has the second sink device 2311 and the second 
source device 2313 and in which these devices are connected 
by the two transmission lines 2301 and 2303 having different 
transmission speeds in one-to-one relationship. In each of 
the individual transmission systems 60a and 60b, the data 
transmission is performed on the basis of the synchronous 
information from the video composition device 1020. 
Therefore, the video data 2331 transmitted to the video 
composition device 1020 by the first individual 
transmission system 60a and the video data 2333 transmitted 
to the video composition device 1020 by the second 
individual transmission system 60b are video data having 
the frame synchronization established. In the video 
composition device 1020, the composition processing can be 
performed directly to the video data which are transmitted 
by the respective transmission systems. Further, a buffer 
for absorbing the timing shift of two video data which are 
transmitted by the respective transmission systems can be 
dispensed with. 
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Further, in this individual transmission system, the 
transmission line having a lower transmission speed than 
the transmission speed of the transmission line for the data 
transmission from the source device to the sink device is 
used as the transmission line for the data transmission from 
the sink device to the source device. Therefore, low-cost 
elements can be used as the transmission lines for 
performing the data transmission from the sink device to 
the source device. Besides, a low-cost unit can be used as 
the transmission/receiving unit for performing the data 
transmission from the sink device to the source device. 
Therefore, the low-cost and high-efficiency data 
transmission can be realized. 

In the data transmission system of the sixth 
embodiment, the synchronous information 2404 received from 
the sink devices 2310 and 2311 by the source devices 2312 
and 2313 are inserted in the asynchronous data slot 2402 
of the high-speed transmission frame and returned to the 
sink devices 2310 and 2311. However, in this data 
transmission system, the low-speed transmission lines can 
end at the source devices 2312 and 2313, whereby the received 
synchronous information 2404 is not returned to the sink 
devices - 

In the data transmission system of the sixth 
embodiment, the synchronous information is stored in the 
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asynchronous data slot and transmitted. However, in the 
data transmission system, the synchronous information can 
be stored in the isochronous data slot provided in the 
transmission frame for performing data transmission from 
the sink device to the. source device to be transmitted. 
Further, in the data transmission system, the synchronous 
information can be transmitted to the source devices 23 12 
and 2313, respectively, using the special frame header, as 
shown in the first embodiment. 

Further, in this sixth embodiment, the timing 
reference signal used in the data transmission system is 
a frame synchronous signal which indicates the head of each 
video frame (i.e., indicates the start timing of the signal 
processing for each video frame) . However, when the signal 
processing for each video frame is performed for each of 
blocks which divide the video frame, the timing reference 
signal can be a signal which indicates the timing of the 
signal processing for each of the blocks (block synchronous 
signal ) . 

Further, in the sixth embodiment, the cameras are 
connected to the source devices as the data output units 
external to the system. The video composition device is 
connected to the sink device as the device external to the 
system. However, the data output units external to the 
system, connected to the source devices, can be video 
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transmission devices such as VTR and the device external 
to the system, connected to the sink device, can be a monitor 
or display device of a navigation system, or a video 

recording device. 

Further, in this sixth embodiment, specific elements 
constituting the transmission line in the data transmission 
system are not particularly shown. However, the optical 
fiber can be used for all of the transmission lines 2300 
to 2303. in addition, metal lines (wires) can be used for 
the low-speed transmission lines 2300 and 2302 for 
performing data transmission from the sink device to the 
source device, and the optical fiber can be used for the 
high-speed transmission lines 2301 and 2303 for performing 
data transmission from the source device to the sink device. 

Further, the data transmission system of the sixth 
embodiment can have a structure which comprises a phase 
detector for detecting a phase shift of received plural 
isochronous data in the sink devices 2310 and 2311 as shown 
in the fourth embodiment, and transmits the information 
relating to the phase shift detected by the phase detector 
as the asynchronous data or isochronous data from the sink 
devices 2310 and 2311 to the source devices 2312 and 2313. 
in this case, the source device modifies the reproduction 
timing of the reference signal on the basis of the received 
information relating to the phase shift. Therefore, the 
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sink devices 2310 and 2311 can obtain the isochronous data 
having the synchronization established, even when the phase 
difference between the isochronous data from the two source 
devices occurs due to the data delay on the transmission 
line. 

[Embodiment 7 ] " 

Figure 25 is a block diagram for explaining a data 
transmission system according to the seventh embodiment. 

The data transmission system 70 of the seventh 
embodiment consists of first and second individual 
transmission systems 70a and 70b each independently 
performing transmission of video data, as in the data 
transmission system 60 of the sixth embodiment. Here, in 
each of the individual transmission systems 70a and 70b, 
two data transmission apparatus constituting the system are 
connected in one-to-one relationship. 

To be specific, the first individual transmission 
system 70a comprises a first source device 2512 for 
receiving a data 2521 having high real-time characteristics 
like audio data or video data from a firsL data output unit 
1011 external to the system and transmitting the data as 
an isochronous data Dtl, and a first sink device 2510 for 
receiving the isochronous data Dtl transmitted from the 
source device 2512 and outputting the isochronous data Dtl 
to a video composition device 1020 external to the system. 
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The individual transmission system 70a further comprises 
a first transmission line (low-speed transmission line) 
2500 for transmitting data from the first sink device 2510 
to the first source device 2512 at low speeds, and a second 
transmission line (high-speed transmission line) 2501 for 
transmitting data from the first source device 2512 to the 
first sink device 2510 at high speeds. Therefore, a data 
transmission unit of the first sink device 2510 and a data 
receiving unit of the first source device 2512 conform to 
low-speed data transmission. In addition, a data receiving 
unit of the first sink device 2510 and a data transmission 
unit of the first source device 2512 conform to high-speed 



data transmission. 



In addition, the second individual transmission 
system 70b comprises a second source device 2513 for 
receiving a data 2523 having high real-time characteristics 
like audio data or video data from a second data output unit 
1012 external to the system and transmitting the data as 
an isochronous data Dt2, and a second sink device 2511 for 
receiving the isochronous data Dt2 transmitted from the 
source device 2513 and outputting the isochronous data Dt2 
to the video composition device 1020 external to the system. 
This individual transmission system 70b comprises a third 
transmission line (low-speed transmission line) 2502 for 
transmitting data from the second sink device 2511 to the 



-164- 



second source device 2513 at low speeds, and a fourth 
transmission line (high-speed transmission line) 2503 for 
transmitting data from the second source device 2513 to the 
second sink device 2511 at high speeds. Therefore, a data 
transmission unit of the second sink device 2511 and a data 
receiving unit of the second source device 2513 conform to 
low-speed data transmission, in addition, a data receiving 
unit of the second sink device 2511 and a data transmission 
unit of the source device 2513 conform to high-speed data 
transmission . 

To be specific, the relationship between the maximum 
data transmission speed x (Mbps) of the low-speed 
transmission lines 2500 and 2502 and the maximum data 
transmission speed Y (Mbps) of the high-speed transmission 
lines 2501 and 2503 is shown as X<Y. For example, the 
transmission speed X is 5 Mbps and the transmission speed 
Y is 5 0 Mbps. 

In this seventh embodiment, the first and second sink 
devices 2510 and 2011 and the first and second source devices 
2512 and 2513 perform data transmission using packets, as 
in the sink device 701 and the source devices 702 and 703 
of the second embodiment. 

To be specific, the first and second sink devices 2510 
and 2511 perform the processing of storing synchronous 
information 2530 from the video composition device 1020 in 
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data packets and transmitting the data packets to the 
transmission lines 2500 and 2502, and the processing of 
receiving video data transmitted from the first and second 
source devices 2512 and 2513 and outputting the video data 
to the video composition device 1020. 

In addition, the first and second source devices 2512 
and 2513 perform the processing of generating timing 
reference signals 2520 and 2522 on the basis of the 
synchronous information from the first and second sink 
devices 2510 and 2511 and outputting the timing reference 
signals to the first and second data output units 1011 and 
1012, and the processing of receiving video data 2521 and 
2523 output from the first and second data output units 1011 
and 1012 on the basis of the timing reference signals 2520 
and 2522 and storing the data to the transmission lines 2501 
and 2503 in data packets to be transmitted. 

As described above, the data transmission system 70 
of the seventh embodiment is different from the data 
transmission system 60 of the sixth embodiment in that data 
transmission is. performed using packets. 

Figures 26(a) and 26(b) are diagrams illustrating data 
structures of transmission data which are transmitted to 
the transmission lines 2500 to 2503 (transmission frame 
format). Figure 26(a) shows a data structure of a 
transmission frame on the low-speed transmission lines 2500 
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and 2502 for transmitting data from the sink devices 2510 
and 2511 to the source devices 2512 and 2513. Figure 26(b) 
shows a data structure of a transmission frame on the 
high-speed transmission lines 2501 and 2503 for 
transmitting data from the source devices 2512 and 2513 to 
the sink devices 2510 and 2511. 

As shown in figures 26(a) and 26(b), in the individual 
transmission systems 70a and 70b, transmission/receipt 
designation packets 2601 to 2603 are output by the sink 
device or source device to the transmission lines every 
fixed time period. Thereby, the transmission/receipt 
designation packets are transmitted on the transmission 
lines 2500 to 2503 ot the data transmission system 70 in 
the same cycle. These transmission/receipt designation 
packets 2601 to 2603 include transmission/receipt 
designation information which designates a device for 
receiving data to be stored in the immediately following 
data packet and a device for transmitting the data. 

For example, the transmission/receipt designation 
packet 2601 among the transmission/receipt designation 
packets 2601 to 2603 includes information which instructs 
transmission of asynchronous data from the sink device to 
the source device. The transmission/receipt designation 
packets 2602 and 2603 include information which instructs 
transmission of isochronous data from the source device to 
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the sink device. Here, when information which instructs 
transmission of asynchronous data from the source device 
to the sink device is stored in the transmission/receipt 
designation packets 2601 and 2603, the asynchronous data 
can be transmitted from the source device to the sink device. 

A data packet 2611 following to the 
transmission/receipt designation packet 2601 is a data 
packet including asynchronous data which are transmitted 
by the first sink device 2510 or second sink device 2511. 
As the asynchronous data, control commands from the sink 
device to the source device, response signals for the 
control commands from the source device to the sink device 
(ACK, NACK or the like), or status data (data indicating 
status of the respective devices) are transmitted. 

in addition, data packets 2612 and 2613 following to 
the transmission/receipt designation packets 2602 and 2603 
include isochronous data transmitted by the first source 
device 2512 or second source device 2513. These data 
packets including the isochronous data are transmitted only 
from the source device to the sink device. 

As described above, in the data transmission system 
70 of the seventh embodiment, the asynchronous data are 
transmitted from the sink device to the source device, and 
the isochronous data and the asynchronous data are 
transmitted from the source device to the sink device. 



-168- 



rurther, the data structure of the transmission frame in 
the data transmission system 70 is fundamentally the same 
as the data structure of the transmission frame in the data 
transmission system 20 of the second embodiment. The data 
transmission 70 of the seventh embodiment is different from 
the data transmission system 20 of the second embodiment 
in that the isochronous data are transmitted only in one 
direction, i.e., from the source devices 2512 and 2513 to 
the sink devices 2510 and 2511. 

in this seventh embodiment, the data transmission 
speed on the high-speed transmission line is larger than 
the data transmission speed on the low-speed transmission 
line, as in the sixth embodiment. Therefore, the sizes of 
the packets on the high-speed transmission line are smaller 
than the sizes of the corresponding packets on the low- 
speed transmission lines. 

Next, the operation of the data transmission system 

70 is described. 

in the transmission systems 70a and 70b of the data 
transmission system 70 according to the seventh embodiment, 
the transmission of the synchronous information from the 
first and second sink devices 2510 and 2511 to the first 
and second source devices 2512 and 2513 is performed using 
the low-speed transmission lines 2500 and 2502, and the 
transmission of the video data (isochronous data) from the 
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first and second source devices 2512 and 2513 to the first 
and second sink devices 2510 and 2511 is performed using 
the high-speed transmission lines 2501 and 2503. 

To be specific, in the first and second individual 
transmission systems 70a and 70b of the data transmission 
system 70, the processing of transmitting the 
transmission/receipt designation packets from the first and 
second sink device 2510 and 2511 to the first and second 
source devices 2512 and 2513 in a fixed cycle is performed, 
respectively. When the synchronous information 2530 from 
the video composition device 1020 is input to the first and 
second sink devices 2510 and 2511 of the first and second 
individual transmission systems 70a and 70b in this status, 
the first sink device 2510 performs the processing of 
transmitting the daLa packet 2611 which contains the 
synchronous information via the low-speed transmission line 
2500, subsequent to the transmission/receipt designation 
packet 2601 . At the same time, the second sink device 2511 
performs the processing of transmitting the data packet 2611 
which contains the synchronous information via the low- 
speed transmission line 2502, subsequent to the 
transmission/receipt designation packet 2601. At this 
time, information which designates the sink device as the 
supply source of the synchronous information stored in the 
data packet following to the packet 2601 and designates the 
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source device as the supply destination of the synchronous 
information is stored in the transmission/receipt 
designation packet 2601. Here, the synchronous 
information is a frame synchronous signal of the video data 
which are received by the sink device or information for 
generating the frame synchronous signal. 

Thereafter, a processing of transmitting the 
transmission/receipt designation packet from the first sink 
device 2510 to the first sink device 2512 via the low-speed 
transmission lines 2500 repeatedly every fixed period is 
performed in the first individual transmission system 70a. 
For example, in the transmission system 70a, after the 
transmission of the transmission/receipt designation 
packet 2601, the transmission/receipt designation packets 
2602 and 2603 are transmitted. Here, these 
transmission/receipt designation packets 2602 and 2603 
include information which designates the source device 2512 
as a supply source of video data to be stored in the 
immediately following data packet and designates the sink 
device 2510 as the supply destination. 

in addition, in the second individual transmission 
system 70b, after the transmission of the daLa packet 2611, 
a processing of transmitting the transmission/receipt 
designation packet from the second sink device 2511 to the 
second source device 2513 via the low-speed transmission 
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line 2502 repeatedly every fixed time period is performed 
as in the first individual transmission system 70a. For 
example, in the transmission system 70b, after the 
transmission of the transmission/receipt designation 
packet 2601, the transmission/receipt designation packets 
2602 and 2603 are transmitted. These transmission/receipt 
designation packets 2602 and 2603 include information which 
designates the second source device 2513 as the supply 
source of video data to be stored in the immediately 
following data packet and designates the second sink device 
2511 as the supply destination. 

On the other hand, in the source devices 2512 and 2513 
of the individual transmission systems 70a and 70b, when 
the transmission/receipt designation packet 2601 and data 
packet 2611 are received from the sink devices 2510 and 2511 , 
the timing reference signals 2520 and 2522 are reproduced 
on the basis of the synchronous information included in the 
data packet 2611, and the timing reference signal 2520 and 
2522 are output to the first and second data output units 
1011 and 1012. These timing reference signal 2520 and the 
timing reference signal 2522 have the same frequency and 
the same phase- Then, the video data 2521 and 2523 which 
are output from the first and second data output units 1011 
and 1012 on the basis of the timing reference signals are 
input to the source device 2512 and 2513 and retained, 
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respectively. The frame synchronization is established 
between the video data 2521 and the video data 2523. 

in the first source device 2512 of the first individual 
transmission system 70a, a processing of returning the 
transmission/receipt designation packet 2601 from the first 
sink device 2510 and the data packet 2611 to the first sink 
device via the high-speed transmission line 2501 is 
performed. In the first sink device 2510, the 
transmission/receipt designation packet 2601 and data 
packet 2611 which have been returned from the first source 
device 2512 are abandoned. Similarly, in the second source 
device 2513 of the second individual transmission system 
70b, a processing of returning the transmission/receipt 
designation packet 2601 from the second sink device 2511 
and the data packet 2611 to the second sink device 2511 via 
the high-speed transmission line 2503 is performed. In the 
second sink device 2511, the transmission/receipt 
designation packet 2601 and data packet 2611 which have been 
returned from the second source device 2513 are abandoned. 

Thereafter, in the first source device 2512 of the 
first individual transmission system 70a, every time the 
transmission/receipt designation packets 2602 and 2603 are 
received via the low-speed transmission line 2500, a 
processing of returning the transmission/receipt 
designation packets 2602 and 2603 from the first sink device 
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2510 to the sink device, storing the video data 2521 from 
the first data output unit 1011 in the data packets 2612 
and 2613 subsequent to the transmission/receipt designation 
packets 2 602 and 2603, and transmitting the data packets 
to the first sink device 2510 via the high-speed 
transmission line 2501 is performed. Similarly, in the 
second source device 2513 of the second individual 
transmission system 70b, every time the 

transmission/receipt designation packets 2602 and 2603 are 
received via the low-speed transmission line 2502, a 
processing of returning the transmission/receipt 
designation packets 2602 and 2603 from the second sink 
device 2511 to the second sink device, storing the video 
data 2523 from the second data output unit 1012 in the data 
packets 2612 and 2613 subsequent to the 

transmission/receipt designation packets 2602 and 2603, and 
transmitting the data packets to the second sink device 2511 
via the high-speed transmission line 2503 is performed. 

Then, in the first and second sink devices 2510 and 
2511 , the transmission/receipt designation packets 2602 and 
2603 which are received via the high-speed transmission 
lines 2501 and 2503 are abandoned, respectively. In 
addition, in the first and second sink devices 2510 and 2511, 
when the data packets 2612 and 2613 containing the video 
data are received, the received video data are output to 
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the video composition device 1020 as the output data 2531 
and 2533 of the sink device. 

These video data 2531 and 2533 are data which have been 
input from the first and second data output units 1011 and 
1022 to the first and second source devices 2512 and 2513 
in the status where their frame synchronization is 
established. Therefore, also at a time when the video data 
are output from the first and second sink devices 2510 and 
2511 , the synchronization of the video frame is established. 

Here, the data packets 2612 and 2613 are abandoned 
after being received by the sink devices 2510 and 2511. 
Therefore, these data packets 2612 and 2613 are not re- 
transferred to the source devices 2512 and 2513. 

As described above, the data transmission system 70 
of the seventh embodiment comprises the first individual 
transmission system 70a which has the first sink device 2510 
and the first source device 2512 and in which these devices 
are connected by the low-speed transmission line 2500 and 
the high-speed transmission line 2501 in one-to-one 
relationship, and the second individual transmission system 
70b which has the second sink device 2511 and the second 
source device 2513 and in which these devices are connected 
by the low-speed transmission line 2502 and the high-speed 
transmission line 2503 in one-to-one relationship- in each 
of the individual transmission system 70a and 70b, the data 
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transmission using the packets is performed on the basis 
of the synchronous information from the video composition 
device 1.020 . Therefore, the video data 2531 which is 
transmitted to the video composition device 1020 by the 
first individual transmission system 70a and the video data 
2533 which is transmitted to the video composition device 
1020 by the second individual transmission system 70b are 
video data having the frame synchronization established, 
in the video composition device 1020, the composition 
processing can be performed directly for the video data 
which are transmitted by the respective transmission 
systems. Further, the buffer for absorbing the gap of the 
timings of the two kinds of video data which are transmitted 
by the transmission systems can be dispensed with. 

in each of the individual transmission systems, as the 
transmission line for the data transmission from the sink 
device to the source device, the transmission line having 
a lower transmission speed than the transmission speed of 
the transmission line for the data transmission from the 
source device to the sink device is employed. Therefore, 
low-cost elements can be used for the transmission line for 
performing the data transmission from the sink device to 
the source device. Further, a low-cost 
transmission/receiving unit for performing the data 
transmission from the sink device to the source device can 
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be used. Thereby, the data transmission can be performed 
at low costs and with good efficiency. 

In the data transmission system ol Lhe seventh 
embodiment, the data packets 2611 including the 
asynchronous data which have been transmitted from the sink 
devices 2510 and 2511 to the source devices 2512 and 2513 
are returned from the source devices 2512 and 2513 to the 
sink devices 2510 and 2511. However, in the data 
transmission system, it is possible that the data packets 
2 611 from the sink devices 2510 and 2511 to the source devices 
2512 and 2513 are not returned to the sink devices. 

Figures 27(a) and 27(b) show data structures of 
transmission frames in the data transmission system in which 
the data packets 2611 from the sink devices 2510 and 2511 
to the source devices 2512 and 2513 are not returned to the 
sink devices - 

Figure 27(a) shows a data structure of a transmission 
frame on the low-speed transmission line from the sink 
devices 2510 and 2511 to the source devices 2512 and 2513- 
Figure 27(b) shows a data structure of a transmission frame 
on the high-speed transmission line from the source devices 
2512 and 2513 to the sink devices 2510 and 2511- 

In the data transmission system, after the 
transmission/receipt designation packets 2701 are received 
from the sink devices 2510 and 2511 by the source devices 
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2512 and 2513 via the low-speed transmission lines, the 
transmission/receipt designation packets 2701 are returned 
from the source devices to the sink devices via the 
high-speed transmission lines. Here, the 
transmission/receipt designation packet 2701 which is 
transmitted on the low-speed transmission line from the sink 
device to the source device includes information which 
designates the sink device as the transmission source of 
information such as the asynchronous data included in the 
following data packet 27 02 and designates the source device 
as the supply destination. On the other hand, the 
transmission/receipt designation packet 2701 which is 
transmitted on the high-speed transmission line from the 
source device to the sink device includes information which 
designates the source device as the transmission source of 
information such as video data included in the following 
data packet 2703 and designates the sink device as the supply 
destination . 

in addition, the data packets 2702 including the 
asynchronous data which are transmitted from the sink 
devices 2510 and 2511 are received by the source devices 
2512 and 2513, and thereafter disappear in the source 
devices as the transmission line ends. 

Further, the data packets including the video data 
which are transmitted from the source devices 2512 and 2513 
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are received by the sink devices 2510 and 2511, and then 
disappear in the sink devices as the transmission line ends. 

In this data transmission system, the return of the 
data packets including the asynchronous data or video data 
from the receiving side device to the transmission side 
device is not required. 

In this data transmission system in which the data 
packet containing the asynchronous data or isochronous data 
is eliminated on the receiving end and not returned to the 
transmission end, only the data packet 2702 containing the 
asynchronous data exists in the transmission frame for the 
data transmission from the sink device to the source device, 
and only the data packet 2703 containing the isochronous 
data exists in the transmission frame for the data 
transmission from the source device to the sink device. 

In this seventh embodiment, the transmission/receipt 
designation packet designates the device for transmitting 
the immediately following data packet and the device for 
receiving this data packet. However, a transmission 
channel and a receiving channel can be previously allocated 
to each device, whereby the transmission/receipt 
designation packet designates the transmission channel of 
the device for transmitting the data packet and the 
receiving channel of the device for receiving the data 
packet . 



Further, in the data transmission system of the 
seventh embodiment, the synchronous information is stored 
in the data packet as asynchronous data and transmitted. 

However, the synchronous information can be stored in the 
data packet as isochronous data to be transmitted. 

Further, in the data transmission system of the 
seventh embodiment, the synchronous information is stored 
in the data packet as asynchronous data and transmitted. 
However, in the data transmission system, the sink devices 
2510 and 2511 can multiplex the synchronous information as 
a reference of processing timing for the isochronous data 
with other packets using a special transmission/receipt 
designation packet, to transmit the multiplexed packet to 
the source devices 2512 and 2513, respectively, as shown 
in the second embodiment. 

Also in this case, in the source devices of the first 
and second individual transmission systems constituting the 
data transmission system, the same frame synchronous signal 
(timing reference signal) can be reproduced on the basis 
of the synchronous information from the sink devices. 

In addition, in the data transmission system of the 
seventh embodiment, the transmission/receipt designation 
packet is transmitted every fixed time period. However, in 
the data transmission system, the transmission/receipt 
designation packets can be transmitted at arbitrary time 
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intervals . Also in this case, the same effects as those in 
the data transmission system of the seventh embodiment can 
be obtained. 

Further, in this seventh embodiment, the timing 
reference signal to be used in the data transmission system 
is a frame synchronous signal which indicates the head of 
each video frame (i.e., indicates the start timing of the 
signal processing for each video frame). However, when the 
signal processing for each video frame is performed for each 
of blocks which divide the video frame, the timing reference 
signal can be a signal which indicates the timing of the 
signal processing for each of the blocks (block synchronous 
signal ) . 

Further, in this seventh embodiment, the camera is 
connected to each source device as the data output unit 
external to the system, and the video composition device 
is connected to the sink device as the device external to 
the system. However, the data output unit which is external 
to the system and connected to the source device can be a 
video transmission device such as vtr. Further, the device 
which is external to the system and connected to the sink 
device can be a monitor, a display device of a navigation 
system, or a video recording device. 

Further, in the seventh embodiment, specific elements 
constituting the low-speed transmission line and the 
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high-speed transmission line in the data transmission 
system are not shown. However, the optical fiber can be used 
for both of the low-speed transmission lines and Lhe 
high-speed transmission lines. Or, metal lines (wires) can 
be used for the low-speed transmission lines 2500 and 2502 
and the optical fiber can be used for the high-speed 
transmission lines 2501 and 2503. Also in this case, the 
similar data transmission system to the data transmission 
system of the seventh embodiment can be realized. 

Further, the data transmission system of the seventh 
embodiment can comprise a phase detector for detecting a 
phase shift of received plural isochronous data in the sink 
devices 2510 and 2511, and transmit information relating 
to the phase shift which is detected by the phase detector 
as asynchronous data or isochronous data from the sink 
devices 2510 and 2511 to the source devices 2512 and 2513, 
as shown in the fourth embodiment. In this case, when the 
reproduction timing of the reference signal on the basis 
of the received information relating to the phase shift is 
modified by the source device, the isochronous data having 
the synchronization established can be obtained by the sink 
devices 2510 and 2511 even when the phase difference between 
the isochronous data from the two source devices occurs due 
to the data delay on the transmission line. 

Further, in the data transmission system according to 
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any of the aforementioned first to seventh embodiments/ the 
sink device transmits the synchronous information to the 
source device* However, in the data transmission system, 
the source device can generate synchronous information and 
video data, and transmit multiplexed data which are obtained 
by multiplexing the synchronous information and the video 
data as isochronous data. 

Hereinafter, the description is given of a case where 
the source device transmits a multiplexed signal which is 
obtained by multiplexing the video data and the synchronous 
information as the isochronous data. 

Figures 28(a) to 28(e) are diagram showing the 
processing of performing data transmission using the 
multiplexed signal . 

in the source device of the data transmission system, 
a processing of multiplexing a timing reference signal 2801 
(figure 28(a)) and video data 2802 (figure 28(b)) is 
performed and a multiplexed signal 2803 (figure 28(c)) is 
generated in the multiplexing processing. Here, the 
multiplexed signal 2803 includes synchronous information 
2801a for reproducing the timing reference signal 2801. 
This synchronous information 2801a represents the phase of 
the timing reference signal 2801 for the operational clock 
of the system (i.e., the operational clock of one of the 
sink device, source device, data output unit and the video 
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cumposition device). For example, this includes the frame 
number, line number or block number of video data. 

When the multiplexed signal 2803 is received by the 
sink device, a timing reference signal 2804 (figure 28(d)) 
and video data 2805 (figure 28(e) ) are generated in the sink 
device by the reproduction processing for the multiplexed 
signal 2803 . 

As described above, in the data transmission system 
according to any of the aforementioned first to seventh 
embodiments, the source device can transmit the multiplexed 
signal 2803 (figure 28(c)) which is obtained by the 
multiplexing the video data and the synchronous information 
as the isochronous data, instead of transmitting the video 
data 2802 (figure 28(b)) between the sink device and the 
source device or between the source devices. Also in this 
case, the sink device can easily reproduce the video data 
2805 (figure 28(e)) and the reference signal 2804 (figure 
28(d)) which is synchronized with the video data. 
(Embodiment 8] 

Figures 29(a)-29(c) are block diagrams for explaining 
a data transmission apparatus of the eighth embodiment. 
This data transmission apparatus is used as the sink device 
or source device of the data transmission system of the first 
embodiment, for example. 

Figure 29(a) shows a common structure of the data 
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transmission system which is used as the sink device or 
source device in the data transmission system 10 of the first 
embodiment. 

This data transmission apparatus 2910 comprises a 
controller 2901a for performing a processing of receiving 
a transmission data Td from an input side transmission line 
2900b, a processing of transmitting the transmission data 
Td to an output side transmission line 2900a, an accessing 
processing of data for a data processing device 2900 
external to the system and a processing of outputting 
synchronous information Is received as the transmission 
data Td, and a reference signal generator 2902a for 
outputting a timing reference signal 2908a on the basis of 
the synchronous information to the data processing device 
2900 . 

The transmission data Td include isochronous data such 
as video data, or asynchronous data such as control commands 
and status data, in addition, the data access processing 
of the controller 2901a includes a processing of receiving 
synchronous information 2907a from the data processing 
device 2900 and transmitting the synchronous information 
as transmission data to the output side transmission line 
2900a, a processing of inputting/outputting an isochronous 
data 2906a such as video data to/from the data processing 
device 2900, and a processing of inputting/outputting an 
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asynchronous data 2905a such as control commands to/from 
the data processing device 2900. 

When the data processing device 2900 is a data output 
unit such as a camera or video reproduction device, this 
data transmission apparatus 2910 operates as the source 
device of the first embodiment. In addition, when the data 
processing device 2900 is for example a device using plural 
pieces of isochronous data such as the video composition 
device 1020, this data transmission apparatus 2910 operates 
as the sink device of the first embodiment. 

Figure 29(b) shows a camera 2920 having a network 
control function, which is used as the source device in the 
data transmission system 10 of the first embodiment 
(hereinafter, referred to as a camera device) . 

This camera device 2920 comprises an image-taking unit 
2903b for performing an image-taking processinq on the basis 
of a frame synchronous signal 2908b and outputting a video 
data 2906b, a controller 2901b for performing a processing 
of receiving the transmission data Td from the input side 
transmission line 2900b, a processing of transmitting the 
transmission data Td to the output side transmission line 
2900a, an access processing of data for the image-taking 
unit 2903b and a processing of outputting the synchronous 
information Is received as the transmission data Td, and 
a reference signal generator 2902b for outputting a frame 
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synchronous signal to the image-taking unit 2903b as a 
timing reference signal 2908b on the basis of the 
synchronous information is. 

The transmission data Td include isochronous data such 
as video data, or asynchronous data such as control commands 
and status data. The data access processing of the 
controller 2901b includes a processing of receiving an 
isochronous data 2906b such as video data from the 
image-taking unit 2903b and transmitting the isochronous 
data 2906b to the output side transmission line 2900a, and 
a processing of inputting/outputting an asynchronous data 
2905b such as control commands to/from the image-taking unit 
2903b. 

When the camera device 2920 provides the system with 
the synchronous information, the data access processing of 
the controller 2901b also includes a processing of 
transmitting a frame synchronous signal 2907b from the 
image-taking unit 2903b as the synchronous information to 
the output side transmission line 2900a. 

In this camera device 2920, the image-taking unit 
2903b operates as the data output unit 1011 in the data 
transmission system 10 of the first embodiment. In addition/ 
the control 2901b and the reference signal generator 2902b 
operate as the controller 201bl and the reference signal 
generator 202bl in the first source device 102 of the first 
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embodiment, respectively. 

In the so-constructed camera device 2920, the video 
data are output from the image-taking unit 2903b in 
synchronization with the reference signal inherent to the 
isochronous data which has been reproduced by the reference 
signal generator 2902b from the synchronous information Is 
(i.e., frame synchronous signal). Thus, in the data 
transmission system having a plurality ot the camera devices 
2920, frame synchronization between video data which are 
respectively output from the plural camera devices 2920 is 
established. Therefore, in the data transmission 
apparatus (sink device) for receiving plural pieces of video 
data in the data transmission system, plural pieces of video 
data having the frame synchronization established can be 
obtained . 

Figure 29(c) shows a camera (camera device) 2930 
having a network control function, which is used as the 
source device in the data transmission system 10 of the first 
embodiment . 

This camera device 2930 comprises a video compression 
unit 2931 for compressing a video data 2906b which is output 
from the image-taking unit 2903b and outputting a compressed 
video data 2906c, in addition to the construction of the 
camera device 2920 as shown in figure 29(b). Therefore, in 
the controller 2901b of the camera device 2930, a processing 
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oi transmitting the compressed video data 2906c in place 
of the video data 2906b to the output side transmission line 
2900a is performed as the transmission processing of 
isochronous data. 

In the data transmission apparatus 2910 as shown in 
figure 29(a) , the camera device 2920 as shown in figure 29(b) 
and the camera device 2930 as shown in figure 29(c), the 
asynchronous data which are received from the input side 
transmission line 2900b are input to the controllers 2901a, 
2901b. Therefore, the data transmission apparatus 2910 and 
the camera devices 2920 and 2930 can be controlled by the 
asynchronous data . 

Further, in the data transmission apparatus 2910 and 
camera devices 2920 and 2930, status signals which indicate 
the statuses of the devices are transmitted by the 
controllers 2901a and 2901b to the output side transmission 
line 2900a as the asynchronous data. Therefore, in the data 
transmission apparatus 2910 and the camera devices 2920 and 
2930, operational statuses of other devices constituting 
the data transmission system can be detected. 



